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NOTES FROM THE EDITORS 



■< J / • 

Jhia' issue of INVESTIGATIONS IN SCIENCE EDUCATION' contains the 



crltlgal abstpacc'a and analyses of nine articles. Although these v 
nine articles have not been clustered, there are some common variables. , 
Several relate to cognitive development {ind/or learning: Allen, Bredder- 
^man, Lawson, and Scotft. Others focus on instruction: Anderson and Lee, 
Hibbard and Novak, Parker* and Mertens, an^ Venderbifoucke. ^ One related 
to scientific literacy: Doran. ; • 

If 

Also included are three reisponses jto articles previously published 
■ * • 

in I.S.E* We are pleased that the authors have provided additional 
|.nfprmati*on about tHeir research and that they have attempted to answer 
or respond to-comments raised in the abstractor'^ analysis section 
of the paper reviewing their publist^d research. We* hope that other 
authors will feel- free to respond towor comment about their article 

an reviewed fqr I.S^E^ \ , ' . 

■V • ■ ■ ■. . y - .. . s 

" . . r' • ' Patricia E. Blosser ' * 
■ ^ Editor . 

\ , ' Robert L. S'teiner \ 
Associate Editor 



Allen, L^lle R. *'An Examination of. the Ability of iThird Grade 'Children 
from t(he Sclei^ce Curriculum Improvement Study (SCIS) to :jdentify 
■'Experimental Variables and Xo Recognize Chftpfge." Science Edubat ion. 

• 57(2): 135-151, 1973. ' 

Descriptors— *Cognltive;. Development; Curriculum' Educati^tfL 
Research; *Elementary School Science; *In8t/uction; *Longitud- 
inal Studies; Science Course Improvement Project; *Science 
^ EducatioYi 

Expande4 Abstract and Analysis Prepared Especially for J,S,E* by Lowell 
J* Bethel, University of Texas at Austin, ' 



Pyrpose ^ 

The, purpose of the study was to compare the performance on specif ic tasks 
related to some SCJS objectives of third graders who had participated 
in a SQIS Program versus third graders who had nqf:, 'Specifically, the 
children were Qompared on their ability to: 

» • ■ (.• 

h 

\l. Identify variables In a system '< 
'2« ld»itlfy change? In a system 

■ : ' . » , 

The research hypotjveses tested in t'he study*'but not explicitly stated 
are as follows: * 

\ ■ " ' _ ■ ■■; . 

1. There will be no'^dlf ferences between the groups in their 



ability to Identify vairlables In a system « 

2. There will be no differences between groups In their ability 
to^ Identify changes In a system* 

3* There will be no differences between male and female pupils 
In their ability to Identify variables In a system^ 

4» There wUl be no differences between males and females In 
their ability to Identify changes In a system, 

5, Thf^e will *be no| differences between socio-economic status 
and the ability to Identify variables In a system, 

6» There will be no dlfferWces between socio-economic status 
< and the ability to Identify changes In a system. 



Rationale * '# 



This study Is but one pf a series written by the author and based on a 

longitudinal study conducted Xo determine the effectiveness of the SCIS 

program on children's acquisition of specific scientific concepts ^ 

* 

process sklllns, and positive attitudes toward sclenqf . The author I9 

attempting to assess the effect of the program qn children's Intellec- 

Xx^ development. As the children proteed through the program, they 

♦ * * ■ 

are Evaluated on th^e basis of the program's stated objectives. At this 

point In time four studies have pi^eceded thtf^ report. Thus, the study 

was an' extension of previous studies an^ It appears* that this research 

will continue for the n^xt three years (grades 1-6). 

I 



Research Design and Procedure 

^ I 

When the Initial study was begun somfl^three years ago, 50 children were 

randomly chosen from three- soclo-ecoitomlc levels (upper, average, and 

lower). Thus, a total of 150 pupils participating In the SCIS program 

from three socio-economic levels was chosen. Next, schools having 

similar children but i;iot participating In the SCIS^program were 

selected and again 50 pupils from each of the three socio-economic 

levels were chosen. This made a grand total of 300 pupils who partl- 

clpated In the longitudinal study conducted up to this point in time. 

However^ because o£ mortality, only 176 pupils were av^lable for this , 

particular study reported. The male-female ratio was jUst about 50/50 

with an equivalent number of children representing each of the three 

socio-economic levels. All chlldjren were from the third grade, ^wlth 

* f 

half participating In tjhe SCIS program continuously over a period of 
three years. The chlldrei^ were evaluated' at the conclusion of . the 
third academic^ year. • ^ ^ * 

The experimental design. used Is the post test-only control group design 
as defined In Campbell and SUmley' a article. At the completion of 
the third year, after having &tudled the SCIS Physical Science Unit, 
all chlldrert wer^ tested Individually J'ln a room set aside -tor this 
purpose (Or at a, lanal table/' All children were evaluated on five 



tMt Items presented one-at-a'-tlme»* Four of the Items required the 
children to Identify changes that took place when # candle was lit • 
%rlth a wooden match and coverlid by a glass b^aker*^ The Items .were 
designed so that children could matdpulate ob*3ects and explain their 
actions* Responses were recorded for the children on each of ^he 
iteips presented. 

Children who were not participants in the SCIS program were exposed 
to some science instruction. The author reports that* their science 
program consisted qf a science text entitl'ed Concepts in Science 
which placed 'heavy reliance on verbal interactions rather than the 
physical manipulation of objects* In other words, it was not a science 
inquiry program, but one in which children were taught elementary 
science using the traditional methods so prominent during the first 6(]^ 
years of this century. ^ 

The author summarized the number of pupi^ls and their sex in the three 
socio-economic levels used in the study* Thus, one can see at a glance 
^J^he total nuiriber of pupils: both SCIS and non-SCIS, their sex, and 
*>t;ttieir division within the three socio-econotnic levels identified: 

As for the findings of the testing undertaken at the close of the 

school year (May- June, 1977), the author notes that ifi a previous 

» 

stujdy the five test items used loaded heavily oji a "cognitive factor" 

using factor analysis methods* The author goes on to say that, "in 

the interest of clarity," a separate analysis of eacji item will be 

presented using ANCOVA methods* The Califor^^a Test of Mental Matifrity 

(CTMM) was used as the covariate* It is also reported %hdt the average 

correlation for each item and its scale total based on factor loadings 

« 

was 0*71* 



There jar e several taBles in the article which summarize' the testing 
resul|s** Tasks on which the data are summarized are as follows: 

,^1. Variables effecting time taken to transfer water u&ing an 

^ A - 1 . ^ 

eye dropper* I ^ r 



iropper* , ♦ \ 

iSts effecting level Natt JLic 



2* Vmrlabxes effecting level Natt «hich a plastic syringe floats^ 

3 
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3. Variables effec^tlng the distance A stone fs thrown by a 
slingshot. 

' ' * ■ ■ ■ . 

4. " Variables effecting the distance travelled by a toy truck. 

, 5. Changes that occur during an experiment* This was further 
• subdivided Into three parts: ^ 

♦ 

a* • clianges observed in a burning candle ^ 

b* cha^nges observed in the match and ^match-box 
s 

c. chants observed when a beaker is lowered over £ burning 
candle * * ' 

Analysis oX covariance for the factbrs of scleqce program, sex, ahd 
socio-economic level are presented for the five tasks* Mean scores, ^ 
standard deviations, and t-tests for the three socio-economic levels 
on four of the five tasksL are reported* In addition, sxmmiaries of 
the children's i^esponses to the five tasks are listed and categorized 
Into SCIS ~ non-SCIS and socld-^econoinlc levels. 



V 

Findings 




The ANCQVA revealed that there were significant differences between 
SCIS children and non-SCIS children on all five of the tasks. The 
'dif ference, was In favor of the SCIS ehlldten» Three of the analyses 
revealed that there was a difference between males and Jemale^ In 
favor of the boys on tasks 3, 4, and 5. With respect to soclo-^ 
economic level, an^Tlyses revealed that there was a significant 
difference. T-tests Indicated that, on three tasks, the Upper socio- 

» 

economic group .outperformed the other £wo socio-economic groups while 
the average group outperformed t^ie lower «group on one of the tasks* 
No significant interaction effects were found or ^ej^orted* 

Interpretations ^ ^ 

The author concludes ^that , on the basis of^the .flndln|{8 repotted 'In 
the study, Honolulu third grade pupils who had participated In the ' 

J. . . . . • ' J ■ - ' 



SCIS program are significantly better 'than third grad^ pupils enrolled 

f ^ ♦ . * ♦ ^ 

In a traditional^ science program* oji their ability to Identify yarla- 

bles and changes j.n systems. 



ABSTRACTOR'S ANALYSIS 

Several questions are raised after reading the study. The introduction 
Is vetry skMpyV^ While It does refer to a continuous evaluation of the 
SCIS program. It vdoes not place the present, study In proper pexspectlve 
relative to the ot|ier studies referred to In the bibliography • What 
-Is the overall lonjt- range objective of the longitudinal study? How 
does this study rerate to them and the overall l^gltudlnal study? 



The purpose of the study Is straight forward* Hofcrever, no mentlpn Is 
made as to why evaluation of the SCIS Physical Science tinl't Is/yiade .4iid 
hot the Living Science unit. Why not evaluate the prbgram Sit%^tX^^^ . 
pu^ls have ex{)erlenced both units? What slgrflf Icance doel6 tlw^wf&ical 
Science unit have In relatldn to the Living Science unit? The author' 
notes, too, that "certain SCIS objectlvea are considered/' This Implies 
that there were others and that; these were chosen Instead* Why were 
these objectives covered and not others? One can be led to a conclusion 
that maybie additional publications c^n be produced by using this procer: 
dure of reporting* ^ Clearly a problem statement should be Included and , 
a rationale as to Its Importance or significance relative to science 
education research* . * ' 



A main critic!^ of the study lies in the research design* No research 
hypotheses are ever stated* ^ Isn't the purpose of statistical analysis 

4 ■ 

designed to- test hjrpotheses? These should be stated so that the' fe&der 

♦ , . . 1*. . . 

does not have to -ln|er what they ate. 

While the experimental population for the. study Is l^ntlf led,, no real 
infotnatlon Is provided here In the study. The reader Is ^referred to 
previous studlM_^r this Information. Really good research does inot 
uss thls»type of reporting procedure. The. reader should not Jliave fo 
vtvicir other studies In order to understand the present study. The 

5. 



■( 



population should be Identified. and described In detail* In addition, 
the author does not lden^:lfy the in^C^^denJ; and dependent variables • 
However, they' can be Inferred from reading th/ study • 

Further, no descrlpt^Lon of saflipllng procedure for choosing schools 

and children Is described. Why did certain schools, have the SCIS 

program and others, not? This Is not made clear to the reader. What 

controls were m^de or Intfoduced t;o control for teacher effects? In 

a study such as ,thls, .one woyld want to be i^le £o control fpr this 
♦ 

factor In order that adequate comparisons cotild be made« This has 
to be' done so that one can be sure that differences' found can be * 
attributed to the treatment only, or else the results may be called 
Into question* * ^ 




Concerning the, treatm«i|t, ].lttle Is said about this crucial factor* 
There is no mentloKX of How long the control group has been exposed 
to ^sclMce -instruction of any 'sort* In addition, time and duration 
of,Bciencfe for the third graders is not reported* Also, how many ^ 
teachers were involved in the infttryc^lon of ] science for bo^ the^ 
^experimental and control grouprf What is th<dr background and other 
pertinent information related tb infftructional, methods? These are ' 
Important questions that should be answered in order to evaluate tlie 
effectiveness of the SCIS program* ' 



Only pne sentence is devoted to a descriiition of the testing proce- 
dures used* The tasks used to make' the assessment are adequately 
described « But, who per^rmed the testing? How long did it take 
to test the children? Was there any method used to test the accuracy 
and reliability of the responses recorded? The reliability and valid- 
ity of the tasks are not adequately described heref It is reported 
that they. were piloted with grade three children* But one is^left 
hanging in ten^ of a des6riptlon for this process. This needs to 



•be explained futthet and additional infonbation prCvided here for the 
reader*' ' " ^ . ■ 



The ANCOVA tables sunmarize the data ver^/lfeatly* As was pointed out 
by the author, the scores could have^been cpmbinW and one analysis 



suianarlzed for, all SCIS and. ijon-^'CIS childrens' performance on the 
tasks. It was a good move on tl^'e part of the author to pro^de 
analyses and summaries for all five tasks. ThlsNyrocedure does aid 
the reader in understanding borne of the things tha\ are being con- 
sidered in the evaluation even though it results inVea'dlng some 17 
tables in all. The author ^b^s summarize the data for/means^ standard* ^ 

4 

deviations, and t-tests by socio-economic level in tables ftor fjiur of 
the fiv^ tasks presented. Why doesn't he do, the same for tfi^tiJ^M 
task? No explanation is offereit^for this omission. In addition, the 
author states that tw^ of the analyses show scores iji faydr* of boys, 
yet a critical review of the table reveals three^ such s^gjiif leant 
differences^ in favor of boys* An alternate explanation here may ba 
that the<girls outperformed 'the boys on one x>f the tasks/ ^But this 
remains unanswered in the analyses. 



It is also reiK>rted that the upper socio-economic group outperformed' 
both the average and lower 'socio-^economic groups on three of the tasks 
and the average group outperformed ttie lower soclo-econopic group on ' 
, ofite^of the tasks. But no summarization is presiented . for tha fifth 
task. The author makes no/note of this. Perhaps there were no sighi- / 
flcant differences. But that could have been stateii in the f indfngs ^ 
without including a table. 

After the summary df the f/ridln^s the author concludes that Honolulu 
•children in the SCIS program are superior to children not in a SCIS ' 
program on ability to identify variables. and changes. But no appro- 
priate ^nterpretations or generalizations are made. Is this because 
the focus of the study is so narrow? Certainly tb€ Implications of 
the study ani its limitations shoulci^ be* discussed. Where does it fit 
into the matrix of similar kinds of elementary science program eval- 
uations? Dpes it make a contribution? Doea it shed some light on . . 
«iy of the problems that are *the major concetti of science education 
research? Or, Another way . of posing this question is: Does it reduce, 
clarify, or throw any new light on the original area or plrobiem of 
concern? Does additional resedtch need to be conducted, and what "^dlrec- 
tio9 should it tiake? Unless some of these questions are answered, it is 
dlffl(:ult. to make any judgment about the results of the study. Certainly 



<•% I; 



4 • * 



In reporting research .bf tl\ls nature, questions such as Choe^e listed 
above should not^be left unanswered. 



« « 
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Anderson, 0. Roger and Mae^T. Lee* "Structure In Science Conmunlca- 
^ ilons and Student Recall of Knowledge." Science Education . 
5?(l).:127-i38, 1-975. . . * ~' 

-j)eacript05» — Educational Research; *Inat ruction; Learning 
Theories; *Retentlon; ^Science Edut^t^^ft;- *Secondary School 
k - ' SclenceV Stlmulue Behavior; *V^rbal C<Wunlcatlon 

I&panded. Abstract and Analysis Prepared Espedlally for i;.S.E. by 
.Willis^ J. Horak, University of Arizona, y . 

P ' ' ^ ... 

Purpose 



The putpose of Jthls atudy Was to investigate the relative relationships 

between amount of science content structure in lessdns and the amount ^ 

of knowledge retdln^d ^fter Instructional connjunlcatlon. Ai^dltlonally 

tjtte study was designed to allow analysis 6f fine variations in know-- 

ledge acquisition* These finp variations were then related to the^ 
' . < ■ * ' ■'^ ^ 

^ overall structure of the statements or discourse units containing the 

conimuni(^9ted content « . 

it , " •> , 

\ ' " ' ' * ,7 - ' ^ ' 

Rationale • «r , • 

^ — V , . \ 

J * * ■ 

0 . 

- . • • 1, 

The blo'-'psychological theory, of structure in humau^ communication 
developed by 0. Roger Anderson and presented in his ]i>OQks Structure In 
Teachinj^t; Theory aiid Analysis and Quantitative Analysis of Structure 
in Teaching formed the theoretical framework for this study. Basically, 
this theory holds that the effectivenesa of humafi communication is 
.biasedSby the facts thajt (IX the environihent favored the evolution 
of organisms possessing receptors sensitive to periodic or repetitive 
stlinull, (2) the presence of periodio stimuli in si^acie and time have 
Indifced, through natural selection, the appearance of highly advance^ 
forms of living organisms capable of expjlolting the environment ^y 
.;Utlli;Eijig Information Irt periodic stimuli, (3)' the depfenciency on 
periodic stimulation, SMch as light ^ergy and movement ,of surroundings 
matter, had* induced a perceptual bias to readily assimilate repetive. 
a timul^ thereby producing chmiges in behavior, *and (4) the perceptual 
bias favored by organic evolution and reinforced by periodic visual 



stimuli 4}irln|| cmtogeny produces consminlcatlon pattetns In hl^'er 
animals contal(dng repetitive sounds (Anderson, 1970) • 



This theory may be Interpreted In light of the results of research 
on^ attention and arousal which maintains that too much repetlve 
patterned Input can produce lack of a^ention. Thus, lessotis need 
some novel stimulus onset or repetitive' removal to cause continued 
t^eadlness to receive and to encode sensory Input* Optimum commanl- 
cations would consequently "contain a patteyfi qf integrat^fed discourse 
Introduced by*- a novel stliriulus whloh serves ad an arousal step to pre- 
pare the Individual tp receive some subs^uent communicated 'content 

• ' • ... \ ■■■■■■ ■ ■■■■■ 

"«s ... 

# « ♦ s 

Research Design and Pyoeedure * - • . ■.\ 

This study was conducted in two phases* Subjc^cts for the, first phase" 
consisted of 61 feliale ninth arid tenth grade students in a private 
urban secondary school. Subjects for the s^ond phase, which was* 
viewed as a test of generality of the findings, consisted of "^41 male 
ind fenale students in an urban jvmlor h^gh school* Separate treat-- ^ 
ment cpmmuni cat ions were constructed for each phase of the investiga- 
tion. The topics chosen for the studies dealt with ''African Sleeping 
Sickness'V and "Life in the Ocean" respectively. These topics w^ere 
reasonably un/amlllar to the students and hence prior knowledge should 
not have Interfered with the analysis^ ' ♦ 

For each phase two treatment conditions were 'developed. The tireatments 
consisted of alternating high and low structure spans as aiicertained^ 
by klnetogram analysis of the discourse units. Ope treatment condt- 
tlon consisted of a sequence, identified as ''high- low," containing 
^alternating spans with the pdd spans high structure and the even spans 
low structure. The other treatment condition consisted of a. sequence. 
Identified as "low-high," containing aleernatlng spans with the odd / , 
>spans low structure and the even spans high structure. The amount 
and^kind of Information within each span^ remained constant thus allow- 
ing direct comparison of the high and low structure spans* 
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Audiotape recorded messages were the Instructional node of commuinlca- 

tlon and the 'criterion neasui;e consisted, of a frerf recall response. 

Immediately after, liiatruction students ^ were aiked to list in writing 

^ as many of the Ideas or statementa as It waa possible for them to 

remember. The frequency of recall of the ftpms was plotted on a* 

histogram and compared to the kl^ietogram gtaph, dj^' thcucomiAunlcated 

lesson structure. Tcjtal filcores were utilized to compare the meaii 
^. * • ' * ■ » . 

high-structure VecAll scores with the mean low-structure recall scores. 

Statistical signtficance of the" <fif ferencea In the means was analyzed 

Utilizing a two-tailed t-test. " • 



Findings ' ^ .. . 

The amQunt of structure in a communication was found to be directly ^ 
related to the amount of information recalled after hearing a communi- 
cation. When the klnetogram sloped upwardi or remained in an elevated 
position denoting increased structure^ there Was a corresponding 
iili^rease in the number of item;3 recalled as eyldenbed by the hlsto- 
graltt. In five of fhe six spans- analyzed high structure spans pro- 
duced statistically significant (p ^.05) more recall than low structure 
spans* V 



Interptetatlona 

The ^^Mptdtngs support the theory of human communication outlined pre- 
viously 4^y^. Roger Anderson. The fact that ^e theory predicted the 
observed outcipmes strengthens and enhances its ^Validity * , Additionally, 
the two ph^es of this study showed that science content and student 
grade ife>)el— Junior or senior high sch9ol level — did not affect the 
overall SUDeriority of high struct\ire lessons. One point that needs 
further stiMy, however, is the length of spans and their relationship 
to knowledge acquisition. T*ils Itf evident from the fact that in this 
study one of the longer spans of discourse utl).lzed failed to show * 
flgnlCicant differences between hl^ structure ^^nd low structure tre^t- 
ttents. The results' of tMs study, may also be Interpreted to indicate 



th«t science teachers^ should ''give, conalderat Ion to the amount of 
structure In their )||||iniDunlcatlonB particularly when the students are 
expected to recall and apply this infqrteatlon In situations ^hat are 
openended or provide minimum contextual cues to aid recall 



ABSTRACTOR'S ANALYSIS 

One cannot reflect oa teaching without realizing that teaching involves 

communication* Consequently it is evident that any educational theory 

relating communication and learning should be most useful^ for educators 

Communication and structure in teaching, has be^n researched from ciiaiiy 

viewpoints* Gagne's learning hierarchies/ Ausubel's advance organizers^ 

> ' . *- ■■ * * * . 

Schwab's phjllosophical analyses of content .knowledge , Gutman's psycho- 

t • ■ " 

logical viewpoints of structure and Bellack's work with teaching 

episodes or teaching cycles are just a Ifew of the diverse studies that 

come to mind when qne considers structure in teaching/ However/ none 

of these research areas address themselves as pointedly to indepth 

aiialysis of teacher communicated subject ^ matt e^ s^fucture and the 

quantitative determination of lesson structi^e as does 0*- Roger 

Anderson's kinetic structure analysis* Thus^ research such asVthe 

report reviewed here should reveal new Insights into *the processes of 

symbolizing that constitutes a large part of everyone's schooling* 

Although the theoretical framework for studies of this type was 
developed and published approximately nine years ago, the area has not 
yet been thoroughly researched* However , there are indication^ that 
the theory is being expanded and Integrated* into some long-range 
research programs *v^ One of the weaknesses of the r'epdrted studies 
appears to be the narrow view df achievement as knowledge acquis it ioq* 
In many of the early studies the criterion measures were baaed on 
factual item or. discourse unit or subdtantivfe work identification* 
"^Thls present (reviewed) sti|dy also measured knowledge level responses 
by assessing free recall of specific communicated- facts/* More, recent 
studies such as those repotted In the Journal of Research in Spience 
TMChlng by Mathls and Shrum (1977) and Ferraro/ Lee, and Anderson ^ 



(1977) have expanded the theory to*' include broader achievement 'defini- 
tions-Mid more diverse sample or treatment gro«ips* 

Some research evidence exists which supports, the contention that other 

types of teaching structure do differentially affect knowledge ^nd 
»* * 

appllcatlpn level achievements Peterbon (1977) utilized ATI methods 
and found differential achievement effects when the criterion measures 
were essay and multiple choice tests, the treatments involved * 
structure^, and tlte aptitude measured ■ was manlfest^,,^xlety* * Similarly , 
Horak and Slobodzlan (1978) utilizing ATI metbods, lesson structure 
variables y and an aptitude measure of ^loc^^s of control, found differ- 
ential achievement effects when the crltetlon measures concerned 
science content or science prbcesses^ These other types of' school' 
achievement ma/ be differentially affected by the kinetic structure 

4" I) ' >• 

of the- communicated discourse. Thtis results of the kinetic stimcture 
research need to be expanded^ into areas such as these if it is to prove 

most valuable^or all. educators. 

f . - • ' 

In a recent "^educational article, Glaser (1972) pointed. out that 

A- 

V - 

instructional treatmei\|:sNmust be generated by a systematic analysis 
of the kin^s of psychologlVal processes called upon in each particu- 
lar instructional method and achievement m^a^ure* This admonition 
may be mo^t appropiclate*/or kinetic structure research. The fact 
that external organization of the science infbrmation is lacking 
1(1 low kinetic structure communications mav fo tee ''Students to utilize 
other psychological ptocesses In encodln^the relevant infbrmation. 
Retent;,lon studies may provide some Insights into this area. 

This dtudy ddds significantly to the rationale underlying the basic 

kinetic" structure theory. I-t' not only expands^ the generallzability 

^ \ ^ _ 

of . the theory to other science £ontetit areas, but also to other 

grade levels. Tlfese resrults have been further extended by the more 

recent articles previously cited (Mi^this and Shrum, 1977; Ferraro, 
• ^ to 

Leet and Anderson, 1977). Additionally this research study has pro- 
vlded' a inethod for analyzing ^ine^variations In knowledge acquisition 
by developing communications that alternated highland l()w structure 



0 » f '» 

•pans. The range of thf mean structure coefficients. However, appeard 

• to vary substantially between the two treatment comounlcatldns* For 
the low-'hlgh treatment the reported mean fundamental coeff Iclentii* vary 

* from a low of 0.23 'to a high of 0.48. ^ For the high-low treatment the . 

' ■' • 1 • ~ \, ' 

reported mean fundamental doefflclents vary from a low;6f 0.13 to a 

high of 0.52*^' This differ ejdtlal treatment structure may have affected 

the results of th-ct^-test a^lysls In an undetermined way. 

■ ■ 

In this research. report it is stated that, in a sense, each subject 
served as his or her ovra cott-rol fot extraneous variables since %l^e 
perfonoance qf the subjects wlt|i high a^tructure spans, was- compar^ ; A 
against 'their performance vlth low structure spans. From the "report. 
It is questldtiable whether tills l3 exactly trujB since, , for 'example, | • 
subject^ with a high structure treatment on span two ^were^ compared j . 
with different s lib jtects with a low structure treatment oje^ span two. : 
This was trye for all six of the analyzed spati^. The i^ulnber of dlst- 
course units in each span was; not equiallzed to allow such, a direct 
comparison. \ i \J , ' . 

The description of the underlying theoretical base Is most helpful. 
The extension <J^ the basic theory based on neurophystologlcal con- 
cepts Is also very "useful. i This dl^scusslon Is quite ln«depth and 
therefore quite Informative -for readers not entirely familiar with 
the presented theory. More studies need to present this type of In- 
depth rationale. Thg identification and explanation of the structure^ 
coefficients was concise and und6rsta9dable.^J{cWever, a more ^ 
thorough explanation of the scdrlng^;procedures of the free recall ^. 
\ test wpuld have been helpful* One winders If there is a relationship 
between the number 1Q.6 reported for low structure span three and t;he 
nuoiber 7Vl reported for high structure span one. If a student recalled 
ILVord that is a substantive word in four discourse units in a span 
does this word get tabulated in one or in four discourse units? One 
example of a scored span would have helpe^l immensely. Additionally, 
this may have been clarified by reporting the nuDdber of discotirse 
units in each span. ^ ' • ^ ' 



ERJC • • ' , . , • 



Overall^ thl* research report Is Very thorough* It is* well written 
an4 understandable* People not famlliav with kinetic structure 
analysis of communlcat Idn^ can profit from the overview of the theory/ 
that la presented.* A fuijther analysis of reports cited and Instruc- 
tional methods employed In the design of the experimental research 
may reveal that basically kinetic analysis of communications may have 
a large Input on Indlylduallzed programmed learning. It may also 
affect futjure textbook format and overall curriculum design. More 
teachers need to pe aware of thes« findings related to knowledge ^ 
acquisition and cqmmunicatlon structure^ ' ■ 
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Purpose ^ yfe^ 

♦ * ^ ■ » ■ 

» " ■ . .• 

••V • 

The majot purposes of this study ilere: 

1. To determine if the ability to control variables could be 
acquired at an earlier age by students receiving relatively 

♦ * ' ' 

extensive formal training. 

» . / 

t • 

2. To assess the relative effectiveness of external -relnforcp- 
meht and cognitive conflict-based treatments. 

Rationale > ■ 

^ — : ■ ^ ■ ' . 

* ■ • ■ \ ' ' . ' 

Tl^ .Study is grounded. primarily on Pi Jfeeti an- research. "InheXder and 
Piaget (1958) reported that children typfcally wet^unable to control 
Variables until 14 or 15 years of age. The present study sq\xght to ,^ 
determine If that age level could be lowered. 

Piaget *s equilibration theory provides rationale fot the second pur- 
pose defined above. Furth (1969) describes the theory in writing, 
/Mie essential point in the 'knowing circle* is the internal structure. 
The circle assimilates or incorporates the real event into the struc- 
ture and at the same time accommodates th6 structure to the particular 
features. of the real event." The emphasis is on internal conflict 
which- upsets existing cognitive equilibrium. Learning results when 
'liquilibrium is restored through accommodation of internal cognitive 
.structures. ThV equilibtation model is contrasted with othet theories 
which place a high^value on external reinforcement. . . 



RwTch Design^ and Procedure * "* 

The •ubjects of this study w/ere 27 fifth and sixth grade iatudenCs from 
a 8ln$l« school* The population. consisted of all of the students In 
the two grades (230) less a special class of slow learners. Students 
were randomly selected from the population and pretested until 27 who 
could not control variables were identified. The 27 subjects were 
partitioned evenly (9 each) among three groups: ^control, external 
reinforcement y an4 internal cognitive conflict* ^ . ^ 

There were three test adpplnlstratlons: the pretest (mentioned above), 
t]tke po^ttest, and a retention test* Baaed on Information given* In 
this report, the design cap be diagrammed according to C^pbell ^md 
Stanley (1963) as follows: / 

■ - • ' ■ 

0 Xj^ • 0 0' i 
'2 



» 0 0. 0 



0 0 » 



A dif f er€!ht teert form was used at each administration (observation) . 
The forms were all patterned after those used by Inhelder and Piaget 
(1958) and weir^ identified as "rods/' "springs," and "levers." Each 
provided a situation .In which ^flve Independiiint variables and one 
dependent variable wete operating* / ^ ^ ; 



During the treatment phase, students In the reinforcement and coii- 
fllct groups recelved-^tralnln 
ment sessions for each group* 



flict groups received- training individually, there were four treat- 



Th« reinforcement treatment focused on having the student repeatedly 
carry out 31 properly cbnt rolled experiitents. The predominant tactic 
WM to talk tl\e student through a 'series of controlled experiments so 
«8 td reveal a consistent pattern of variation bet^^een the dependent 
and one independent variable. The Mudent was then asked to pred;tct. 
ft the effec,t on thj dependent variable of a particular change in the ' 
0Q« Indepejident varia^let 



For the treatment destined to Induce conflict the, student vag led 

. ^ 

through a sequence of 31 expetlments in which two or three Indei^endent 

varlablea were ch^ged In eaqh experiment « However^ the change In one 

J ' , ' , # 

of thesf varla^ea and the 4|pendent variable followed a consistent 
pattern giving* misleading support for establishing an Invalid rela- ^ 
tlonshlp between them and for lgnoi;lng other changed variables^* 



Findings 



At the time of 'the;^ retention test, nearly half of the subjects were 

controlling variables* The mean age of the subjects was 11 ♦ 8 years « 

■ t ' ■ . . ^ . 

/ 

•hie post and retention test means for the three co^mblned groups were 
found to ^ significantly different (p< ♦Ol) from the pretest aeans* 

\ 

However^ while the mean scores Were slightly greater for groups 
receiving training, the differences among the groups on any of the 
three tests were not significant (alpha »« ♦05) ♦ 



Interpretations ' ' ^' 

The author concluded the following: ^ ^ 

1. Numerous experiences with, problems requiring ^the controlling 
of variables can accelerate the development of this ability^ 
.for some fifth and sixth grade children* ^ 

' 2« Conversely, soma children's development of the ability at 
this age may be unaffected by formal training* 



i 



3* It 'makes 'little difference whether the draining involves 

experiences including external reinforcement, the Inducement 
of cognitive conflict, or merely the repeat^ed posli^g i)f the 
problem ,to be solved. 
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ABSTRACTOR'S ANALYSIS .> 

■ ' • ' * • ■• . ■ 

Validity of the Study, The author seems quite safe < in concluding that 
•xtemal reinforcement might not be necesGTary for behavioral chanj^e to 
occur. And such a finding Is supported by the(^work d.f SmedslunE (1961). 

Hovever, the fact that all groups (cognitive-conflict, external reln- 
f(^rceiQent, and Contrdl) made essentially the sam^ gains raises some 
question about what Is necessary for behavioral change* Could the 
gains have been the resul-t of what Campbell and Stanley (1963) call 
maturation, history, testing, or interaction of testing and X? The 
author insightfully suggests a problem with testing* A SoloioDn Four- 
Gtoup design would have been most appropriate here« 

The question *on maturation/history is still 'of interest, however, since 
the length of the study is not given in the report ♦ Not only were the 
posttest means for' all groups significantly higher than pretest meAis 
but all groups performed slightly better on the retention test than -on 
the post tests « How long were the periods between pretests, post tests, 
and retention tests? . v . 

Other questions might be raised about^the three test forms ("rods," 
"springs," an^ "levers") used In determining the subjects*, abilities 
to control variables* Of major concern is whether or not the three' 
are equivalent forms ♦ Further, thd order In which the forms were * 
admlnistet^(i. is not entirely clear* One can*-only infer that "rods" 
the pretest, "spring?" the posttest, and "levers" the retention 
test* . ' 

» 

The author found that at the retention test nfearly half of the 
subjects were operating at the formal operational l^v^l (substage 
IIIB)* The mean age of this group was 11/8 years* While that age 
i8^8li^tly lower than found by Piaget and his associates, it is of 
interest that other researchers have found fomial operationar to 
develop several ye4rs later dwin 11*8 (Runner and Laws dn» 1973)* 



R0sm»tch Design. The research design reported for this study Is 
adequkte* However^ the description of the sampling technl<iue leaves 
some questions unanswered/ It I9 stated that the sample was drawn 
fro^ 230 fifth and sixth grade students « However,, "a special class 
'Pt slow learners wn excluded from the population to be sampled/' 
The number of students Inxhe slow learners class ^as not given* 
Thus 9. what was the sizta- of actual populatlbn? 

-V ♦ * 

The ^act method of sampling Is also unclear* Were 31 students 

randomly selected and then that group pretested "until 27 who did 

not control varlabliBs were Identified?" VLore likely, students were 

Vandpmly seleqt^ one at a time from the, population , and pretesjiecf 

until the 27 students who would participate In the s^u^y were Iden- 

tifli^d*. i ' ^ 

' Finally, the author does not Indicate that tH^ 27 students were 
randomly ^signed to the three groups* If random assignment^ had 
been made (or reported If they were made) the research design dia- 
grammed above would have been strengthened greatl^* 

A - ■ ■ . . 

Suggestions %r Written Reports. This written report conveys Its 
message quite well* The abstractor feels, however, that the report 
jBuffers fjem a very common problem* Namely, .It, Is the problem of 
condensing a relatively l^rge study (In thls/^case a doctoral thesis) 
Into a journal article* In this article, for exampfle, the Introduc- 
tion and discussion seem to. Include much more than Is needed to 
adequately Inform the re^dj^* Excess material can oft^ make an 
article difficult to follow* . 

What to Include and what not to Include In a journal article become 
critical decisions* And these decls^ns, are especially difficult 
for the author, of the .larger piece (e*^*, the thesis) to make; 
he/she is often too close to the study* It would, therefore, be 

vise for him/her to have a colleague not connected with the study 

.^** » . ■» - . . . _ ■ . . . _ .. 0 

to review tfte journal piece for- clarity and preciseness* 
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Purpose * . , ' * 

■ • . • . * „••.,., ' N. . ^ 

The general purpose of this study was to InVfestljJate "correlational 
associations between test Instruments which. In the opinion of the 
Investigators » meas^ured "natur^ of scdence" .objectives* Tp. this endi 
flvei^search hypotheses ve;:e posited, ^^here wllP be a^ positive cdirre-^ 



latlon between: ^» v 



A. The> "Nature of ISci^nce Scale" (Klnfcall, 1^68) test and sub- 

t:ei3ts of the "Te[8t on the Social ^^Bpectls ll Science" (Korth,* 
' ■■(l969): ' * . /. J'i'- -V ■■ '^^ ■ ' , . - 

The "Nliit^lre. of 5cl«fioe Scale" test and sub l^e^ts of the 
, "^.plencfe "^upport^ Scale" (Schwlrlan, 1968) ^test, ' . 

C. 'Subtests of the "Test on the Social. Aspects of Science" and" 
. V subtests of the "Science -Bupporjt S«^le".test. ^ 

The su|)te^^ts^pf the **Test^on the Social Aspects of ^Science/' 

E. T)ie subtests af the "Social Ast>ecti| of Science" test. • ^ 



0 



tlatlo nallB > * ' . ' 

The-studty Is* couched In^the framework of^t^cent ttrends In scttence 
teaching/ Tha)^. Is^ a claim Is ^rnade that science educators have 
' become ^ncre^tslngly concerned that students understand more th^n 
facts, concepts,^ and tecphnologlcal appllcatlpns of science* ^ Addi- 
tional comcema* have been "that students^'lSnderstand how sclentl&ts 
opetate,lhaMfe correct attj^tudes about scieitce and scientists, and 

1 ■ <-■ • ' . - • 



know what^ science Is feaUy like." Objectives related to these 'latter 
concerns are termed "Nature qf Science" objectives. 

Aftet examining elevfsiv"t 69 1 instruments which 'liad been constructed 
«nd Vnllda;:ed for objectives related to the Nature of Science," the 
Investl^gatc^rs decided, there was little agriBement about the measure- 
ment of ^Oflersta^dlng of nature of science-type objectives even though 
the Instruments "contain many , common Ideas and statements." The study 

Mjfl undertaken to caist 11^ t upon this obse':i^at;lon^ 

' • ft 

' Research Design and .Proce^ur.e 

Pour^Crlterla were established to select^lhstmiments for the study. 
<(1) "The Instrument should^ either be broad and comprehensive In scope 
or hive pertinent s^ub tests Reasoning — the jiature of/sclence *as dis- 
cussed by science educators has various coinpoi\ents • (2) "The Itejos on 
the Inatrumekit should be compatlbDle with a Llkert-typ^ response 
formjjt." Reasoning — There ^Is not always a "correct" or *"lnCofrect" 
position with reg^rd^ to nature of science' objectives . (3) , "The 
Instrument should be .e£^^lly readable by ^Igh schoal students." 
Reasbi^lng — the study watt £o be coi|ducted withes tu(tents In grades 9-12. 

V ■ t 

(4) "The Instrument shbuld' be Relatively short." Reasoning— the 
.liistrument could be administered during one cl'^^s period, and students 
%rould not be apprehensive or reluctant to partlcli^ate If not confioiited 
^th a massive, complex Instrumeat. 



Three Instruments were selected based upon those criteria'.- T^e . 
"Natnre of Scitftce Scale" (NOSS), 'the "Test dn the Social Aspects of 
Science?' (TSAS) , and th^ "Science Support Scale"; (SSS) . The TSAS and 
the SSS had subtests; the NOSS iJld not. - ^ "* 

Using four high schools (grades 9-12)., the Investigators Identified 
approximately 300 students who were enrolled in science courses. A 
random one- third o if each class was given each instrument. 



I' 



Findings 



SCudenta chose thfet ^'agtee" resppnse more frequently than the "strongly 
agree** responae for moat Itenup and likewise for the "disagree** resppnse 
and *!atrong]fy disagree'* response* Before the correlational analysis 
was undertaken, **strongly agree** an^' **agree** responses were combined as 
were **str(cmgly disagree** and ''disagree** Responses for each Item of each 
Instnonent* 



To test the hypotheses » correlations wei^ tested for significant differ^ / 
ences' via the t statistic* ^ **^(A) Eleven correlation coefficients 
greater than ±0*21 were considered significantly different frotd zer^ ^ 
(cr<rp.*05» N«'69)* The restilts are suiniDairlze4 In Table I* 



Table* I 

^ Significant IntercorrelatloriiilrCoef flclents 
yc^f TSAS Subtests, SSS Subtests, and NOSS 



Variable TSAS-1 TSAS-2 TSAS-3 TSAS-4 TSA$-5 SSS-1 SSS--2 SSS-3 SSS-4 SSS-5 




NOSS 



24 
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,1. Hypo theals A was m>t supported. 

2« • Hypothesis B was not supported* 

3. Hypothesis C was flot supported^ ' ^ 

,4. Hypothesis D Was^^sypported for 6 of the 10 correlations. 

9. Hypothesis E Was 8|mfpdrted for 8 of the. 10 correlatlOiti^^ 



Inteipretatlons 



respond 



Possible explanations for students' tendencies to rj^spond ''agree" and 
"disagree" as opposed tJdr "strongly agree" and "strongly disagree" were 

1. reltictance tq "go otit on a limb"; 

2« lack of complete familiarity with words ai^d phrases In the 
Instruments* statements; atid ^ 

3. agreeqient with part of a complex statement but disagreement 
with another part of the same statement, ; 

V 

Ihe Investigators suggested an Interview with subjects as a means of 
understanding this phenome(ii5fi'and the underlying crudes. However^ 
this possibility was dismiss ed, stating,. It "was not a maj on dimension 
of the study." 



Wt^th regard to the ^resulting tests of hypotheses , the Investigators 

concluded "that the IteoB used to measure broad areas, of the nature 

of science (doSS) are not related to Items that measure pertinent or 

s^clflc^ areas of the nature of science (TSAS and SSS) •" It was also 
* ' ».. » * 

doncluded that the TSAS and the SSS Instruments were measuring 

s^arate domains within the nature of science since subtests of each 

ihstmment were related within but not across Instruments. 



It was recommended that science educators should give attention to * 
outlining the entire domain of the nature of science In order to 
attain relationships among the various^ components. To this^end^ » 
the^ investigators developed an outline by elaborating upOo^^e major 
components. « , ^ ^ 



1. Mtthodr and AlinB of Science * 

2. C%aracterl8tlc8 of Scientists. 

^ 3* Aaaumptlona of Science ' ^' ' 

4# Processes of Science / 



5* Interaction of Science with: 

A, Soct^y * , 

B. Technology ' 

ABSTRACTOR'S ANALYSIS 

t 

^/IChe reviewer of this research report agrees with the Investigators^ v 

that objectives related to the broad descriptive phrase, nature of 

science, ^have been and coiltlnue to be Important to science educators.* 

There Is also agreement "^that Instruments which are commonly construed 

(not necessarily by |*the original authors) to assess knowledge or attl 

tudes related to nature o£« science are very diverse even^though thev 
/ . . . ▼ 

contain ''common Ideas and statements*'' 

The title and Introduction to. this research report led this reviewer 

* to hope the investigators had^ attempted to' discover unity in. the wild 
variety of these instruments in a way Somewhat akin to Bronowski^s 
description of science As ''nothing else than the search to discover 
tlnlty in the wild variety of nature* (1965, p» 16) • However, the 
purpose — by now^ seemingly out of .context — stated the intention' "to * 
investigate the relationships between three selected instruments «'* 
Translated into r^earch hypotheses, one finds that another corre-^/^ 

* lational' study is in the offing* 

r Given the contradkctory nature of the rationale for the study, this^ 
revle%fer was surprised to see the research hypotheses stated in posi- 
tive terms* Would it not have been more appropriate to have stated 
the hypothc»ses in a neutral manner? That is to ^ay, does not the 
rationale belle the pos8i%>llity of expressing directional relation- 
»htp»? 
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The four criteria and their respective Juetlfdcatlon for selecting 
Instrunents were reaaonable. However^ they were, aimed more at admlit- 
Istratlon of the Instruments as opposed to substantive Issiies related 
to^ nature of science objectives* If the study was truly to be **e'n 
analysis of several Instruments measuring ^Nature of Science* 6bjj»c- 
tlyest'' more crlter4.1ii should have been offered* An exampllb wotild be^ 

4-., • ' 

'^The Instruments should each contain subtests which purport to. assess 

' ♦ " • *■ 

the same dimensions of the nature of science* ''^^ e 

With regard to the study sample » the Instruments'^ were admlnlsterejd 
to "approximately 300 stud^ts at four area high schools who were 
currently enrolled In^sclence courses at grade levels 9-12*" In a 
research report It Is Important to specify exactly' how, many subjects 
were Involved* Where were these four high schools located? How did 
these students compare In terms of: 1) p^^t science courses; 2) 
interest tn science; 3) types of science courses in which currently 
enrolled; apd A) future aspirations? What was the stratification of 
students by grade level by high school? A reader is alyays at a loss 
Jto underq|:and and Interpret research findings and conclusions if he 
does not ^ gi^^at deal ^bout the study population and sample* 

With regard to^^ta analyses and the results and conclusions^ the 
investigators stated that, ''Prior to the analyses^ strongly agree 
and agi^ee responses were comblneid as were strongJLy disagree and dis- 
agree responses for each item*" They claimed the procedure "is done 
with most studies using Llkert scale responses*" No* references were 
cited to attest, to the claim or to give credence to the collapse of 
tlie data* This reviewer does not recall' collapsing of Llkert data 
as a comdion procedure in the context of the i^lenned statistical 
analyses* One would wonder why the collapse in response choices 
was .not^ done prior to administering the instruments fact the 

collapse procedure was planned a priori * • 

there were three potential explanatlantf offered for the observation 
that students chose the less extreme responses more frequently than 
the more extreme "strongly" responses-71) students were afraid to 



**go out on a ilnb;" 2) students' lack of conplete familiarity with 

words or phra8e9 In the Vtatemehts;" and 3) "agreement with part 
olf. a c6aq;>lex statement and dlsagreemenl with another part." The 
latteir two reason^ raise serious questions about the completeness of 
the Criteria usied to choose Insttuments for the study and the Inves- 
tigators^ applications of those criteria which wei:e posited. 
Addltlofially, this research report does npt describe a pilot* study. 
Based upon the foregoing results and their potential explanations, 
on^ Is reminded again of the crucial Importance of conducting one or 
more pl^ot studies prior to a major study. . ^ * 



At this juncture 9 It Is appropriate to point out that no statements 
were made about Instrument reliabilities In the context of this 
particular study. The investigators evidently have decided, to join 
the ranks of those persons who either. do not determine or who do not 
report reliability values. / 

The investigators Inserted a paragraph into the research repoft which 
compared the percentages of re9pon8e8 t)n the NOSS^instrumeat made by 
Students in their study to those made by scientists, science majors, 
t>hllosophy majors, and science teachers in Klmball^s (1968) study* 
Not only was it out of context (no rationale'^or hypotheses prepared^ 
the reader for such comparisons). It was inappropriate. Ah examina- 
tion of Caiif>bell ^nd Stanley's (1963, pp. 5-6) short monograph will 
illuminate this criticism. V 

The hypotheses and their associated statistical tests left this 
reviewer with seyeral questions. Why were the research hypotheses 
stated positively when^ the introduction leads one to believe the 
investigators found "little agreement about the measurement^ of under- 
standings*^ of nature of science objectives? With the research 
hypotheses stated in a pos^ltlve sense, why were the correlations 
^^tested for significant differences from zero" using "all correlation 
coefficients greater than ±0.21" as being significantly different from 
Mto? The investigators* means of expressing themfsielves Indicate they 

4 

do not understand differences between research and null hypotheses and 
differences -between one and two>talled statistical tests. 

28 „ , 



Additional questions must be ralsf^d relative to the statistical Jfibts. 
Why d%d the Investlgatots base their tests on a saipple size of 69 
wnan there w^re "lippVoxlmately 300** subjects In the study? With 11 
Ihdtercorrelated variables, did the Investigators not recognize their 
resulting decrease In alpha level?*" Finally, In Interpreting their 
Iresults table, why did the Investlgato:^ conclude that TSAS-^5 was 
not! statistically correlated \)lth TSAS-3? 

The rnvestlgatot^ ended their report with ^ an outline of their con-*^ - 
ceptlon of the domain of the nature of sclenc^. Without discussing 
the merits of their outline, this i^evlewer would only suggest that a 
research report Is not the appropriate medium In which to Introduce 
such' a model. 
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Purpose * . ■ -m- 

A8* Stated by HibbarcJ and Novak, "A primary purpose of this -study was to 
understand the cognitive structures which children develop with respect 
to solids, liquids and air, whether on their own or through formal 
*Un8t ruction." • * ^ ^. 

r ■ ■ , ■ 



Rational 



Citing research on science concept learning and that utillzing-A~T 
instruction, the authors attempted to "show how pupil achievement of 
science concepts follows patterns consistent with the learning theory 
of Ausubel^ 

A central hypothesis to this subsumpt ion-based learning theory is 
that ^"all leaming-*^acquisition of new knowledge or reorganization of 
existing knowledge is based on new inforpation impinging on the 
learner, and also on the particular cognitive structure of that 
learner at the start of the learning tasks/* " 



Research Design and Procedure 

The one-shot case study was conducted with "childi:^n In four first- 
grade classes in two elementary schools In Ithaca^^New York;«/* The 
84 "instructed" children Received a four-lesson Introduction to A-T 
lust vuct ion and a "tenf*lesson V|l4quepce dealing with aspects of the 



particulate nature of natter and effect of energy exchanges on particles 
of iaatter." Each lesson required approximately 18 minutes for comp^e^ 
tlon.v 'The Instructional schedule provided for ojie lesson to be 
accoiipllshfd each' week. 

The 3ff 'Sinin^tructed" children .received only tHe four-lesson. Introduce 
tory aeqi/ence to familiarise them with A-T methods so they could be 
tested subsequently via pictture tests with audio instructions. The 
"^normal first-grade classes ha4 "little or no science instruction^^ and 
hence the 'unlnstructed* group constituted a control group similar in 
age and other experiences^ but not exposed to A-T science lessons^ 
Students in the 'uninstructed^' group were In the same schooi^.^. but 
different classrooms^ than their ^instructed' peers. No statement of 

4. 

selection procedures was Included." ^ ' 



The evaluation procedures used involved two formats,: 

1. tests including 'production* and 'recognition' questions. 

2. 'individual interviews modeled after Piaget's Clinical . 

technique. ' . . ' 

An example of a plcture-pr<Hj»nrtiQn question was "one. which showed a 
person standing near a cWar glass bottle full of * smelly* liquid. ' 
The child was asked to pisietend that' the smell could be seen and then 
to draw the smell." A parallel picture-recognition question "showed" 
a set of drawings^ each with the same person and smelly substance but 
each with a different representation of how a smell might be drawn. 

The child was asked to select the best representation of a "smell." 

J 

The production^ type questions were administered before the recognl,- 
tion items to avoid cueing.. Each child heard Che typed instructions 
to these tests via headphones. Children were tested ift groups but 
they were Isolated from eac)^ other by cardboard partitions. One 
hundred picture test questions were organized into four booklets and 

administered to both groups of stud^ts ovei^ a two-week period. 

■ - - . • V 

Additionally, 25 Instructed and 10 unlnstructed children were randomly 
•elected and Interviewed Individually. "The Interview technique 



Involved an Individual child with hands-on material in a sequence of 

4 
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questions calling for predictions, manipulations, observa|:ions, and 
explanationp.^ Two interview questions were vety similar to the pic- 
ture questions, while the tl^lrd, calJ^ U-tube Interview, was described 
as "a novel problem-solving situation." In this intetvleV coffee is 
poured into two U-tubes,/one containing water >and tfie othet only air 
and the child is asked |bo smell. at the other end of each tu)>e. 
witesponses to ^1 IntejT^iews were taped fo^ subsequent analysis! 

/ 

The duration of the entire study was apparently 16 weeks (1^ weekly 
lessons flind two weeks of picture te$ting) plus any delay between " 
Instruction and^ testing (which was not specified) and time required 
iot ijadivldual interviews. ^ , 

#• ■ . ' 

I 

The children's responses were not scored. * "Instead, a system- of cate- 
gories was derived to group responses for each question. The 
categories were intended to distinguish, between students with dlffe^ 
en t' cognitive structures in a certain conceptual area, i.e., the 
relationship between a material ^d its smell.'' *The Authors recog- 
nized that there would be some variance in responses among those 
grouped in any single category. "This grouping of response^, while 
it may make the data more convenient to manage and may be functional, 
potentially hides information as to particular differences in 
children's structures." . * 



Findings 

With^ respect to the responses to the questions requiring students for 
drawings of smells, the author's descriplHons were the following: 

V 

1. 66 percent of the instructed (I) and^6 percent of the 

unlnstructed (UI) children used dots to rej^resent a ^mell. 
The remainder tised lines or some other forms of represents- * 
tion. 

\ 

. ' - ■ ■/ 
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• 2/ 30 percent of the I and 2 percent, of the UI groups drawing 
ehoyed" the smell going all, around the. room, not just to a 

^ nbae* The others drew the smell going just to a nose or*one 
placr^* In the room^/^ 

* t 

3. 55 percent of the I and 12 percent of the UI drew a model 
vH.th the smell prlgln^tlng at or within the source of the 
smell. The other children showed the smell originating 
above the source* . 



A. 



23 percent of the I and more of the UI group used a dot m)del 
V >fh^ch showed the smell coming from the source and going all 
around the room. 



Responses to questions requesting drawings of the "Inside of" a solid, 
a liquid, and air were generally similar to the above, but the at^thors 
recognized t^at some student's drawings are "difficult to" Interpret 
and the children's knowledge is linderestimated by this type ofctest." 
Interviews with selected children were . used to probe the limits \f 
cognitive dlff ereii^tlatlon which may allow some insight into chilflren's 
le&tnlng. „ 
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From ^these results the\ authors believed that many Instructed children 
seemed to have develope^a more sophisticated model for smells and 
the states of matter — man^employing a particulate mbdel. However, 
they questioned whether "this cognitive differentiation will be use- 
ful for problem solving in newXsltuatlons.!' Related to this question, 
^e results of the U-tube interview were cited. ^'The instructed 
children differed from the unlnstrue±ed mainly in their more prevalent 
use of mechanisms to explain how wateV could block some of the smell 
than could the air." Thpir use of mechatd-smsf may be an indication of 
th« increasing cognTltive differentiation this concept area and 
•bllity to, in a qualitative way, iiianlpulate\everal relevant varia- 
bles 'simultaneously/* 

\ * 

The students^ who were classified as using particuiaW mechanisms 
explain the U-tube phenomena (N-5) also used particulate explanations 
to the other two interview questions. The childreh who iiisplaj^ed no 
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machanlsm vlth the U-tube Interview were, similarly unable to use any 
explanatory mechanisms In the other Interviews* 



Int^erpretat loni^ 

According to the authors^ "this study^ shows that Instructed children 
use a particulate model to explain the nature of s.mells much more, ^ 
/effectively than unlnstructed children^ and that they also use some- ' 
whdit better explanatory models for comparing solids , liquids; and 

alt*" Further, some children, "demonstrated their mastery of #he 

t . ' ' ' 

new models by exploring them to solve a -novel problem involving the 
movement of liquids and air." 

The authors concluded that the«^ particulate model used in the ins'truc-^l 
tlon "wjas compatible with the learner's cbgnitiye structure ^and, / 
therefore, many children were al)le to synthesize and/or use a partic- 
ulate model of smells^ f fomHheir previous kriowled^e and informiatlon 
in the instruction*" However^ such synthesis did hot occur as ^ 
frequently with respect to explanations of solids, liquids, and air, 
"presumably because the lesson Instruct i.on and the children's prior 
knowledge were not compatible or t^e extent: of instruction was 
Ina^quate*" . , 

In summary,* the authors inferred that "development of basic science 
concepts in children's cognitive structure is possible and should 
result in facilitation of future learx^ing in science .and in reading 
or riifithematlcal skills where these involve science materials*" 

/, ' . ' . ' 

ABSTRACTOR'S ANALYSIS 

* 

This study is npt a comparispn of results from differing 'methods of 

** " 

^ Inst^ructlon, but an attempt to examine how children's oo^itive 
•tructures change as a fiinctidh of relevant instruction; A-T instruc- 
tion was <ihosen ^because of its minimal need of teacher involvemient and 
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tiaiie in standi^<)l2lng Instruction* The concepts chosen have been 
used exteniilvily In i^ast science education res^rch*. 

While getting any kind of a sample for researSl^ spanning several 
months la (difficulty It would seenT appropriate to aim for largipr 
sample^y especially when^ after secondary selection and analysis, one 
group Is reduced to a sample of flve« It seems Important for the 
readers to know«mo)^^^bout the sample and how It was chosen « Even 
a few brief comments about the school and .tl^e neighborhood would have 
been helpful, A sample chosen from schools largely --composed of 
children of. Cornell faculty may not be representatl^ of D*S. elemen-^ 
tary- schools. Second, the method for choosing vhlch children- were to 
receive the In-depth Instruction should have been specified. Compari- 
sons between cognitive structures of Instructed and unlnstructed 

^groups as reported here Is valid If the groups are* shown to be s > 
similar or were chosen Randomly from some populat^^^|||l, Student self- 

..aeleotlon or t^eacher selection processes have been widely described 
as potentially having biases. These threats to the validity of a 
study are important to all styles of research, Assumedly, the flrst^ ^ 
grade level was chosen because It Is the beginning year of formal 
lnstriu:tlon. However, a cross-Section of students from other elemen- 
tary school grade levels would have greatly expanded the nature of 

possible results and conclusions. The duration of the Instructional 
pr6^ram seems sufficiently long but more details of the contentyj of 
the lessons would have been most helpful. 

The authors' review of related research, specifically with respect to 
science, concept leamlr^, appears to be limited, TWo of the studies 
attributed to the University of Wisconsin R&D Center (7 & 9 In 
original bibliography) were not associated with the UW research pro- 
gram« Further studies fuom the UW group which had particular rele.vance 
to the pictorial dimension of representing partltulate modela of ^ 
BMtters were not cited (e,g, dissertation^ by Hasan, 1968, and Doran^ . 
1969) • ^ ^ 

It appears from Inspection of the article that the following understand^ 

# ■ ./ ■ 

flings jaay be within cognitive atr^ctures related to this content domain. 

. . _ • 



ny of the Ideas incorpo^rated here were firom Che xNwearch t 
ylouily ' by ''Doiran.. 



Through work ajuch aa that done by Hibbard and Novak, it would be 

% . ' 

poeflble to support or refute siich a model or some part of it. As not 
all children follow the>ame learning pattern and tkerefore possess 
different cognitive structures ^ an underlyfhg itt>del or framewoi^ would 
be helpful foij insttucUon B^d evaluatioru 

' / . ' ^Ith Che afddlUon of heat,' solids cl^ange 

. « to liquids and liquids to 'gases 

■ t ' \ 

Part^cles^of matter mow "faster an^-^ 

faster apart when heated ^2^:}] ^ 

In solids 9 the 
pooled together 
within a small 

liquids the particles are loosely 
lustered together and move about. 




In . gases 9 .the particles are 
far apart ^nd move freely • 



Particles of matter attract each other. 
Particles of matter are in motion. 
Particles of matter are very small* 
Particles of matter have spaces between them* 
Mattet is coiqposed of particles. 




The different states of matter are char- 
acterized by various densities, moisture 
content, degrees of visibility, etc. . 



Matter can be described as being 
soli4» liquid. or gas* 



f^igure l.-'^Hypotheiized Structure ot Concepts 



ttiitlng procedure used In thls'^tudy waa very exttnalve: 100 
queatlona adndnlatered over a two-week period. But no> descrlptloii 
vu Included ^of whlcl} phenomena were used In these 100 queHlons, 

how Inany questions focused on solids', liquids, or gsses? With- 
out such Information, l^t Is hard to Imagine the need for 100 quest Ions « 
G r ea t c are_jj:aa, JLAkeiL„t^ the Instruttlons^and other elements 

of the data' collecting. Results of the "production" questions and 
Individual Ititfervlews were discussed in considerable detail, but no 
mention was made of results from; the "recognition" quesl^lons"! 

t|]ie categorization of student responses to Interviews > and their draw- 
Ings Is admittedly difficult; The abstractor Is not sure what the 
Investigators uniquely determined from this phase of the study, as 
contrasted with results ^rom the non-discussed "recognition" type 
questions, "bslng questions with dlstractors constructed to represent 
specific misconception^ anderrbrs, one can still distinguish between 
children with different cognitive structure (see Doran, 1972)/ It 
seems that with the considerable amount of past research on children's 
learning of these partlctdate nature of matter conctepts, such would 
have .beei!^ possible* ' ' 

Research In this conceptual ^rea Is pivotal because of Its use with 
subsequent Instruction oa so many topics. It Is necessary for parallel 
Studies to explore the ability of the youngsters to manlpulate^seveiral 
variables simultaneously and other logical operations described 
Plagetlan theory. These Plaget«-based studies could utilize some of \^ 
^^^^^mf^^ such as^ those use^ In this study. Item one could begin 
^^^^IfS^W^I^^^^^^ Interactions between cognitive structure (a la 
Ausube^^^|%til|!^^vc operations (a la Plaget)^' 

Hlbbard md Novak have contributed significantly In a crucial area. 
It la hoped that they will contlntie to explore the matiiy dimensions 
of aclente concept learning. 
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Purpose 

* ... - 

The purpose of the investigation was to determine the relationship 
between intellectual development and* reading ability. 



Rational e^ 

L ■ 

Through references . to pre^)'iou8 i^esearch, the authors establish a 
logical justification^ for their-laj/estigatlon. First, a connection 
between general, problem-solving capabilities and reading ability is ' 
' documented. Then, reading ability is presented as a complex cogni- 
tive skill with the suggestion that there is a link between general! 
cognitive ability and reading ability. Therefore, it is suggested \ 
that since the Piagetian modek is a comprehensive model of intellec?- 
tual development, a strong positive relationship should exist between 
reading ability and the level of intellecttial development as described 
by Piaget.^ . ^ 



Reaearch Design and Procedure " 



1 



The investigation examined the correlations among scores on ten 
Piagetian tasks used t;o assess levels of concrete and formal reason- 
ing and problem^solvin^ abilities, and scores on the Sequential Test 
of EdUjpational ,Progr<*S8 — Reading Porm 3A (STEP-Reading) Educational 
Tm^I Service^ 1956. The Piagetian tasks were: (1) eonearvation 

• • * c. 
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«f nuBd>er^ (2) conserg^atlon of substance^ (3) conaarvatlon of contln* 
uoua^ quant Ityt (A) conservation of lengt;h» (5) xonaervatlon of^ree, 
(6) Cioniervatlon of weighty (7) conservation of volume using clay» 
(8) conservation of volume using cylinders > (9) separation of varla- 
bleflk» and (10) exclusion of Irrelevant variables. Reading scores 
were obtained for the following: Reproduce Ideas Translate » Make 
Inferences^ Anal5^ze Motivation^ Analyze Presentation; Ctiticize^ and 
Total Score. .» 

After administering, the Piagetian tasks to 506 randomly selected 
students and constructing a frequency distribution of their total 
scores from each of the 10 taskst a subsample of 35 subjects, was 
selected to complete the STEP j^eading examination. The subsample 
was selected to be representative of. each -^of the Piagetian score 
categories from the frequency distribution. The subjects^ 18 males 
and 17 females » were attending an urban high school which enrolls 
predominately black and Spanish-American students. The subjects' 
ranged in age from 14 «0 to 17.7 yea|l. 



Finding^ * - 

The relationship among the Piagetian scores and the rciadlng ability 
scores for the 35 students was examinedvin various ways. A sc^atter^ 
diagram showing the relationship of the Piagetian* total score and i 
the STEP ^otal sc^re was presented along with the Pearsqjpi prodt^olf- 
moment correlation coefficieht for the two variables (.70»^^4i.Xr601). 
An analysis of linear pre^diction (the hypothesis of no difference 
between eta^ and rho^ was accepted at the .05 levep ihdicated th*at 
a linear and significant relatil^nship existed between th^ subjects^ 
■cares on the two instruments. 

■ » . 

« 

The correlations among' each l^i^getian task, and total task score and 
th«)» reading tubtcalijlff^nd total reding score, were also presented. 



tn gen e ralt the corr e lation s w e r e p ds ltlv e a n d-algaif ii;;autv- w1 t h the 



•ore difficult tasks corr^ating more hi^^ly wijih the reading scales 

AO , » ^ 
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than did the •aaler t^aka* Corralatlon* between the Plagetlan total 
•core and each reading aubacale were all positive and algnlficant. 



Jnterpretat lona 

J 

The authors discuss why such a strong relationship^ as evidenced by 
thely correlational results, should exist between reading ability 
and the growth of logical thinking ability* Their premise Is that 
before the subject can obtain a high score on the STEP test, he must 
be able to understand what he has read* Other research on this topic 
is examined and a tentative conclusion that the development of 
logico-mathematlcal mental operations precedes the development of 
linguistic skills is entertained Two Items' from the !STEP test are 
analyzed to ascertain what mental operations are necessary before 
the questions can be answered. After this analysis, the authors 
conclude that "To improve reading cpmpreheiision* • • , it may be argued 
that what must be done is Improve !^ student's thinking ability or 
increase^ his level of Intellectual .development/' 

After reaching the above conclusion, the authors reassure the reader 
that the school can Indeed affect a s^tudent's level of Intellectual 
development, and that an ideal veliicle for t;hla may be through t?he 
teaching of inquiry-type laboratory and field activities in science. 
Three studies are then cited which suppprt t;his content ion^ 

■ » ♦ 

The authors summarize by stating that their interpretation of the" 
results indicates that the present emphasis on readi^kg Instruction ^ 
as a means of improving language development and intellectual growth 
is misplaced, and that the provision of situations which optimize 
the development of tl»e leaihier's ability to think would prove to be 
apre |>eneficial. The authore state that "This development is likely 
to be obtained only when instruction is designed with the -present 
Intellectual level of the child in mind and when the child is allowed 
to In teract with the materia ls of th e discipl ines, with his pe ers, and 
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with his Instructots, to answer questicms which the child himself has 
raised." 
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ABSTRACTOR'S ANALYSIS 

This r«vl«w addresses two levels of concern about the article* The 
note fundamental level characterizes the study as an fx^le of 
Plagetlan research In the behavioral 1st tradition/ To counterbalance 
that method. of research, the cons t rue tl vis t model la IntrcKjluced* The 
second level of concern about the article Involves , the tet^nology of 
the article and research procedures used In the study* 

Current American research on Plagetlan questions .falls Into two prin- 
cipal categories: behavlorlst and constructlvlst (Emerlck and Easley, 
1978) One type Is exemplified In the article being discussed; namely, 
a behavioral appro^^ to Piaget*s theory of cognitive development. 
The behavlorlst approach postulates^ a one-to-one correspondence between 
mental operations and their surface appearance as behavior* On that 
assumption, the article authors claila that the observance of individual 
acts^ is sufficient evidence that certain mental operations are occift- 
ring. That tjrpe of research emphasizes classifying students based on 
their performance on Plagetlan tasks. 

A different type of Plagetlan research postulates that the rJelatlon- 
ships between mental operations and subject behaviors cah be described 
as many-many, Suth an assumption means a single mental operajt^lon can 
manifest Itself In a\ variety of behaviors, only a select few of which 
have been described bjf Plage t. Similarly, a given behavior can be "the 
result of the functioning of a variety of mental operations. In this 
second type of research,- study focuses on the functioning of . those 
operations a^d how they ralate to observed behavior; 

,.C 



The major proposition presented by the authors of the article is: 

If reading ability cifh be viewed as being dependifent upon, 
pT at least linked to, strategies for attacking and solv- 
ing problems which themselves are dependent upon the grou^Lh 
of logical thinking abilities, then there should exist a 
strong positive relationship between reading ability and 
lavel of lntallect{fal development as described by Plage t 
-4^^JUA)^ ^ 
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Thm Authota than dascrlbe a atudy allowing a poaltly^ oorralatlon 
batvaan raadlng ability^ tfa naaaurad by Hha STEP raiidlng axamln^- 
tlOQ, and cognltiva davalopmant* Ah analysis of raa^ng tast Itama 
follows tha description, damonat rating the plauinblllt^^ of the 
assertion that cognr^lve ^development ^ related to reading test! 
performance* Essentially, tlijfe authors contend that hlgh\ performance 
oiij the^ reining test requires high l^el reasoning skills \^uch as 
cAtldzln^. and analyzing. Thus, common sense would suggei^C that 
Improving ]^^ose reasoning skills wbuld In^re^se performance on suqh 
reading ^tests. On the othe;r hand. Improving language ability (which 
Is only a surface Indlca^ifbn of. mental operations, that mi^t be func- 
tionlng) , need not enhance the jjjt^ntal operations generating t;hose 
surface Indicators (behavior). 

Given the argument described In the previous paragraph, of what sij^- 
flcance are the correlational'(data which are the heart of the ai!|tlcle? 
Are these data evidence that subjects the hypothesis to a crltlclpd 
teat? Isn'/t a rational demons^ratiion* of why the same' logical abili- 
ties affect behavior on both t^ts of Intellectual development aA{d 
tests of reading ability more* convii\cing than is correlational study? 

It might 'be argued that'tKe purpose of collecting data, as in the 
correlatlofnal stvidy, lies in validating theories in *'rear world** 
settings.^>v3ehavlorlsts aiid constructivlsts part company over what 
method should be used for such validation efforts. Behaviorlsts 
perform statistical testa to compare groups of subjects, while the 
constructlvl^s concentrate on a small number of subjects in order 
to construct^ models of the relationships between ment*al operations 
and behaviors. 

In the study described in the article, the collection and analysis of 
data merely confirmed what^was later argued in the analysis of (tie " / 
test items, that is, perfor^aance on the reading test probably relies 
on the sailie logical abilities as ^performance on the Plagetlan tasks. 
Would it not be more important and interesting to* explore the. facets 

~ ' .[■ 



of that relationship and its supporting theory? 
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Th« r««4inder of thl« revltw will focus sptclflcally on the tenalnologV 
•nd vampllilg procedures In the article. / 

Thft arguments In the article are persuasive unless the reader pays 
close attention to the terminology and the role the terminology plays 
In the logical developnent of the argument. Essentially, the teha^n- 
ology Is imprecise and, i therefore, elusive. Plaget, 01^ the one hand, 
has defined precisely his meaning of loglco-mathematlcal operations, 
although the jdef Inltlohs might be difficult to comprehend. On the 
other hand. In the article, concepts such as problem-solving capa- 
bilities, proble#soJ^ng strategies. Intellectual deyelopment, loglco- 
mathetbatlcal mental operations, and thinking ability are. all terms used 
without definitions^ or even regularity. Repetition of terms would be 
a sittall price to pay If -a few clearly de'flned temia were to replace' 
the variety of terms currently In the article. 



Examples of the elusive terminology are "reading and language ability'* 
and "thinking ability." The authors argument climaxes with the claim 
that improving students* blinking ability xd.ll Improve their reading 
and language ability... If reading and language ability is defined 
solely as performance on the STEP test, then such a conclusion is 
not very interesting, since translating and making Inferences, analyz- 
lag motivation an^ presentation, and criticizing certainly qualify as 
"thinking abilities." In other words, thinking ablilties include the 
reading, abilities tested by the STEP test. ' Thus, the climax of ^ 
authors* ^argument can be reduced to improiring thinking ability to 
improve thinking ability. If, on the other hand, t\xk authors wish to 
arguj that reading and language ability is somehow a special form of 
thinking ability, there might then be some basis for the claim that 
Iniprovlng, the general skills enhances specific skills. However, the 
aal>lgulty of those concepts in the article makes application of the 
cpncepts difficult' for both educators and researchers. ' 

*. ■ - , ■ : ■ \ 

The ^thodology of the study raises some questions, especially the 
Plagetian aspect of the research. Aii interpretation of Plaget*8 
work ti iff s tent from that in the article contends that Plaget did not 
dMcrll>e subjects* behaviors on his tasks so that .those behaviors 
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could btt used 4a peaaurea of cognitive devalopnent. To limit "correct** 
reaponaea on a Piagetlan taak t:^ a alngle reaponae, auch aa holding 
all variablea cdn^tant Ixcept one, la, to define mental opefatlona In 
terma of behavlora rather -Chan operatilona. Such an approach pre- 
dudea^'conalderation of aubjects' alternative conceptualizatlona of 

« the Piagetlan taaks. Alternative conceptualisations could result In 
behaviors deviating from those described by Plaget when he discusses 
particular ta6kSe For example. If a subject thinks of the variables 
In a problem as Interaqtlng rathet than being Independent, the subject 
might test for the effects of combinations of variables Instead of the 
effects of Independent variables. The first author has observed such 

j behavior and reasoning* in subjects. 

'it 

The article ddes not provide a rationale for the point system for 
scoring subjects on the Piagetlan tasks. Readers shQuld be , given 
an acceptable explanation of why a correct response Id" given credit 
equal to a correct explanation, or why a III-B classification Is worth 

" three times as much as a III^A class 1 fleet ion. Awarding points by 
observing particular Isolated behaviors is not a logical extension 
of Plaget •s theory of development in that thcs^^value" of a behavior 
lies only in the role it. plays as intermediary between the subject •s 
' mental operations and the environment. Therefore, to investigate the 
value of a behavior, the researcher muist generate a plausible explana- 
tion^ the inteVaq^on of mental operations and environment. Then 

^the explanation should be tested s^through observation of actual 
behaviore The hypothesized explanation should be related not only 
to a particular sequence of i>ehaviors, but also should be based on 
a set of interconnected postulates (a theory) which attempts to 
explain a larger piece of reality. 



'\ The sampling procedure fgr the study motivated several questions. 
Ten Piagetlan tasks (only two of which were attributed directly to 
Plaget) were administered to^506 randomly selected high school 
students* The subjects then were grouped according to their scores. 
Out of each group who performed within a range of scores, three or 

four atudeyta conatltuted the whole group ao tkat random aelectlon 
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if»a Ivpoaalble. The practice of combining aubieta of aubjecta who 
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'•oai«tla«a «r« randomly selected and aometloea comprise the whole groups 
it a methodologically dubious procedure, .^y was the correlation 
study jfiot done slnply^on 35 subjects who had been randomly selected * 
from the high school population and who had been administered both 
the reading test and the Plagctlan tasks? An4, an u of 35 for this . 
study seems unnecessarily small since It Is assumed the reading test 

^is more easily admli^lstered than the Plagetlan tasks. ' j 

* ' ■ " * \ ' 

Why does the title of the article contain thl^ word "disadvantaged" 

When no further mention Is made of the concept In the aftlcle? Is 

the reader to assume that "an urban high school which enrolls preA 

domlnaJ:ely black and Spanish-American students" Is by definition 

"disadvantaged"? 

The researchers sampled students in the 14 eO to 17e7 year age range ^ 
a span of 3.7 years. The potential correlations between age and stage 
of Intellectual development and age and reading ability was ignored in- 
the article's analysis. Also, it is peculiar that,* if the emphasis 
of the study* is on reading instruction, why was it not conducted on 
younger subjects^ It is possible the authors wanted to ensure that 
, both, formal operations and high level reading skills were represented 
Ita the sample « Assuming that reading skill and intellectual develop- 
ment correlate!" positively with age^ it is fortunate for the researchers 
that they tested the Wder subjects. It was at the higher reading 
akllls and^ intellectual development that the correlation was strongest* 

In Nummary,' the authors were ingenious in Justifying science teaching 
in terms of Improving treading and language skills. The integration of 
thm two subj^ects to the. mutual benefit of both is a topic worthy of 
more research. For that topic, jit is probably not necessary to incor- 
porate the Plagctlan theory of intellectual development. If researchers 
are Interested in the theoretical relationships of reading skills and 
reasoning skills, then precise definitions and logically^ developed 
argumenta are minimum requirements for meaningful dlscussiqn of the 
topic. . * \ ^ 
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Purpose * 

The purpose of this study was to investigate the^^^ectfs of selected 
programmed units on the test performance and the quality of classroom 
discussion of students enrolled in an introductory college biology 
class ^ ^ 



Rationale - 

Studies examining the effects of programmed instruction on test per--. . 
formance are relatively numerous. In this particular study^the 
authors have been careful to control spurious factors that frequently 
Influence the results of programmed instruction. ^The programmecl units 
did nc^ differ from the conventional units in philosophy, emphasis and 
examples or content . Quizzes were announced well in advance and the 
Hawthpme effect was controlled by experimental design. The second 
hypothesis, that students taught by programmed text will engage in 
higher level classroom dis cuss lonv has, Aot been researched as exten*- 
•ively as the first hypothesis concerning test performance. An intent 
of this study was to add eibpitical support to the tenet that programmed 
iiuit ruction would enrich classroom Interaction, thereby adding a new 
dimension for the use of programmed Instruction as a teaching aid. 

. • ■ * ''if . 



Res j ealrch Deaiyi and , Procedures ^ ^ f 

c and o mly divid e d iiito two s e ctions f o r a s e cond 
eeaester introductory biology clasa. The usual curriculum consisted* 
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of II unlta of biology, t«^ght by Che lecture^dls cuss Ion method with 
each unit having twb lectures followed by. a discussion and quiz. A 
test followed a four-unit sequence and a comprehensive fdnal was given. 
For the study, four programned units, which were written by the lecturer 
wefe substituted for four conventional units.' The four prograimned units 
were Cells, Molecules, DNA an^l Heredity. Each section, which received 
programmed Instruction for only two of the units, was alternately the 
•xperimcntal-or the co^t.r^?I-Sroup« the deStgn for an experimental 
Sequence consisting of a total of four uirlts could be diagrammed as 
follows; . 

>.;« A o o o o 1 1 o 2 3 • 



0^ 0^ X^ 0, X, 0, 0, 

flooo o.o 122- 3 

In which • no treatment (conventional class or neutral units) and 
Xj^-Xj " programmed Instruction units , Cell atid Molecules , respectlvel^i 
0^ « unit quiz for the control group, ^1^^2 " tuiit quizzes "for the 
treatment group and 0^ » the midterm test. 

This design was repeated for the two. remMnlng programmed units. SecT 
tiqn A was the experimental group for the DNA unit and Section B, for the 
Heredity unit. ' . 

> ^ 

^to examine the test score differences between experimental groups* and 
the control groups » the scores were cdtegprlzed aH high 80 percent) 
and low 79 ^percent) and subjected to Chl-square analysis. ^The 
differences between the classroom discussion of the two groups were 
measured by two Judges who tallied student responses according to an 
inventory of high-low discussidKi level indicators. The judges were 
also asked to write an evaluation of the discussion s^d to note any 
difference between the two groups.. They were not told which groups 
were program Instructed. The discussion results were also analysed ' 
with Chi-square analys:^8. 

f 
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Find In 

The Chl-squafe results Indicated that a significantly greater nu]Bjt>er of 
students fell Into the high cattgd'ry than Into the low c^egory f6r 
three of the four programmed uhlts* No significant differences were 
noted for the DNA onlt; On the two midterm tests and the final exam 
the subjects continued to score significantly hlghi^r on the program- 
taught matetlal than on the conventionally taught material. 

Differences between the two groups were pLess ^striking for the class- 
room discussions than for the test performance « The only unit In which 

ao8tatlstli:ally significant difference occurred between^ the two groups 

* ■ ■■' 

waa the unit Dn Molecules « However, the groups who were program taught 
scored slightly hl^er In the discussion analyses for every unlt'^ and 
whfen the tallies from the four units were cumulated^ a statistically ./ 
significant overall difference occurred ^between the two groups. 



» / 
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Interpretation . 

* * • ■ . *> 

The findings of the report Indicated stuclent^ taught with the t^ro- 

*■■ ■■» 

grammed units Improved In b6<th test performance and classroom 
discussion. Due to th^-^ experimental design^ which controlled for the 
Hawthorne/ effect, dl^^rences In content » emphasis f examples ai 
ui4^t>f unannounced quizzes ^ the author attributed ^he "changes 
performance solely to the variation In Instructional techniques. 
Also the final e^m scores demonstrated that tH^ Initial difference, 
between experimental and control group did not fade by the end of ifhe 
semester* 

On a course evaluation form students acknowledged that they .X^if^ed 
note jfrom the programmed units than frpm the conventional units* 
However^ they also Indicated that the lectures were mote Interesting 
and enjoyable. They checked two programs 'as the desirable number oi 
programmed unlt^ to be supplemented Into the course. The results' of 
this study suggest that programmed textbook supplements could be used 
as an effective teachlng^d to bring meaningful variety into the - 
classroom. 



. ........ . , 
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)iii'^fRACTOR*S ANALYSIS 



This study varied from other stu4ie« of programed Instruction in 
soms critical areas. t)ne Important one is that the content of the ♦ 
lectures and programs were parallel's t:he lecturer h^d Written the 
programs. An advantage of any progrlunmed instruction is thst it pro- 
vides immediate feedback and reinforcement pf response'. This seems 
to be any effective proc^ure initially, but- stijidents often become , 
program wise" and learn to make the correct response without really 
hav^g to process the information. A. criticism of programmed instruc- 
tion, is that differenciBS tend to fade with time. TJi^ author mentioned 
this and attempted to measure* it by giving a compi'ehenslve final at 
the end of the course* ^ ' ' 

' Z'- II. ^ ■ « ■ > 

However, I think the notion. of differences fading with time refers to 
the effectiveness on the program being in cdntlnuous >use. ; If Initial 
interest' is high due to the novelty of the teaching procedure, this 
could account for differtfhces in performance. The differences may 
disappear or fade with time after the students become accustomed to 
the programmed method* 

On the evaluation form the students requested that no more than two 
of the Eleven units be;taught with^^ progranuned texts . The researchers 
suggest that t'he programs be utilized as supplements to the conven- 
tional prqcedures ratKer than as a complete substitution for them. 
In this context programs could serve as £a effective Instrument for 
ad'ding variety to normal classroom procedures. 

The experimental deslgi\ was effective for measuring the objectives 
and it helped control threats to internal validity that frequently 
plague studies of programmed learning. The authors attempted to 
avoid' the Hawthorne effect by haviiig each section alternately serve 
,as the experimental group and,'by making lntrag|foup coniparlsons . In 
effect this could have served to heighten the novelty effect described 
by Bracht and^ Glass (1968)^ especially, since each class was exposed to 
Qtdy two programmed units dut of a totsl eleven. The uniqueness of 



withod possibly^ resulted in the students focusing their attention 
more carefully on the content of the unit. If the programs are utl«l- • 
iMd to supplement and to add meaningful variety as the authorik) . " 
Intended In this ptudy, then It may, be worthwhile to trade ^"^tne 
effects of novelty as long as 1^ Is kept In mind that the program 
Is not uniquely responsible for the differences in performance. 

One^ quest Ion that needs i:o be raised in the study is the appropriate- 
ness of us'lng Ghl-square analysis to test the differences between the 
groups* The Chl*-square Is usually (ised f^ir nominal data or the 

median test Is used to measure central tendencies of the two groups 
« 

If analysis of variance would result In violating the , assumptions ^ 
which does not seem to be the case here« No Information was given 
bncernlng the range of the scores or how they clustered within the 
groups* if the standard deviation was low and If the mean was near 
the division point between groups^ It would appear that the nusliers • 
.In (he two groups ^^ould be manipulated to meet the standards for, 
significance* It would have been Interesting to see the me^ns and . 
standard deviations and the F values of the groups tested with an 
analysis of variance • A rationale fgr. the decision to use 
square analysis rather than analysis of \^arlance would help^larlfy 
thfBse questions* 

a ■ . * 

Overall the study was written In a style that was easy to* follow* 
By using the programmed text 'on a limited basld^ the researchers 
demonstrat;ed how effective a prograimned unit can be In improving 
t<»t performance and c^ssroom discussion and they avoided the 
problem of boredom that oft6n accompaiiles a programmed course* 
The hypothesis that/pfogrammed texts used on a limited basis results 
In better test peyfori||ance Is Supported.- The results of the Impdctv 
of programmed Instruction or^ classroom discussion are somewhat 
supported, but th48trength of that relationship Is questionable. ^ 
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Purpose ^ 

The study Investigated the long-term effects of a two- to three-year 
exposure to an Inquiry teaching strategy on students* cognitive styles < 
The cognitive styles ^f the experimental and comparison subjects were 
assessed one and six years after the end of the treatments « 



Rationale ' ;\ - 

In recent years researchers have become Interested In the tactics 
Individuals t^e to perceive and organize external stimuli^ * These * 
tactics are known as cognitive styled « On^ aspect of the research 
Into cognitive styles and their educational Implications has focused 
on the t^pe of cues Individuals use In perceiving similarities and^ 
^ subsequently » In categorizing their environments* This has led to 
the definition of several ^'styles of categorization'* and ''their 
measurement through the use of tests such as the Slgel Cognitive 
Style Test employed In this study. 

lUgan, Moss and Slgel (1963) have found tha^ Individuals show a 
steady, continuous progression from a relatively global >tyle of 
categorization toward a more analytical one. In addition, they 
found that an Individual's style Is resistant to large-scale change 
hecause ^Individuals generally retain their relative stylistic posl- 
^Elons relative to each other. t 



SttVttral iQVMtlgatqra have attempted to shift atudenta' atyles toward* 
vj^f analytical ones. Davla ^1967> reports lltt.lft success In training 
students to be more analytical , In cont^ept Identification -tasks. 
Scott (1966, 1970) "rSported some success but his study did not attempt 
to assess whether the treatment had any lasting effects. This study 
)atten^ted to assess the permanency of style changes In students. 



/ Research Design and Procedure 

The paper presents the results of two separate but related. studies* 
The authqf J^fers to one as a longitudinal study and the other as a 
ci:o8S-sectlonal study. 

• ^: . ■ 

The Independent variable for both studies was the level of exposure 
to the inquiry Strategy, teaching method originally proposed by Suchman 

. (196^) and modified by Scott (1964). ,Two levels of treatment were 
used: no exposure and two or three years exposure during the subjects ^ 
upper elementary and Junior high school year^ In the longituclinal 
study the c6cposure occurred in sciiwce classes during grades A, 5 and 
6 while In the^cross-sectional study it occurred during grades 5, 6 and 

/7. There is no mention of tjje actual amount of instructional time 
spent using Ae inquiry strategy nor any indication of procedures tised 
to ensure that the strategy was implemented ySpproprlately. However, 
the author indicates that careful questionltig of the adbjects revealed 
that the comparison subjects had never been exposed to this strategy 
and that the exposure of the experimentid subjects was limited to the 
treatment 't>eriod. 

/ The dependent variable for the studies was the stjidents* styles of 
categorization as mea/ured by the Slgel dognltlve Style Test (SCST) . 
The SCST consists ^of a series of cards with three pictures on each 
\aard. For each caflrhe subject Indlcaties which pairs of . pictures 
'are related and. give reasons fot the choices;. Each grouping and the 
jreasons given for that grouping j^re scored as belonging to one of six 
styles of categorization: descrijitive-part whole (analytical). 
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dtscrl^ttv*-whol« (non>aA«lytlcal) , r«l%tlonal~cont«xtual, caCegotlcal' 
functional., c«t«gorlft«i--clas8nanlng or categotlcal-attrlbut«. -A 
• tudant's total acora for a^catagory la simply the nunbar of tliAka \ 
ha or aha haa grouped pictures usln^ that style, of dacagorlaatldn. 
For this study only the twelve (12) picture cards 90iniaon to ~tha M 
(male) and F (female) forms of the SCST were uled./ The split-half 
raliabUity for this mpdifiJd form of the SCST was found to be 0.76 
(n - 101) . 

The subjects for the studies were dravm from four large, urban 
schools. For the longitudinal st;udy there were 16 experimental sub- 
jects and 16 comparison subjects. The comparison subjects were drawn 
from an area which"; in 1966 (when the first test was administered), 
had a similar socioeconomic and cultural background to that of the 
area In which the experimental subjects lived and had siipilar tenth 
grade achievement test scores. The subjecta for the cross-sectional 
study Consisted of 26 experimental and 34 compa^risons . The comparisons 
consisted of two classes of high ability high school students. Not all 
of the experim^ntals were in the high ability track— thus the coilpari- 
aon group had a slight edge over the experimental group academically. 
There is no^ indication of .random assignment of students to treatments— 
the students appear ^to h^ye.d|||||cted to receive the treatment. 

;rhe research design used for the longitudinal groups is shown dla- 
gramatlcally in Figure 1. The design appears to be a modification of 
the static-group comparison desigl|( described by Campbell and Stanley 
(1963). ^ 

_0i 92 X - occurred in grades 4, 5 and 6 

^. . the end of grade 7 

02- prior to high school graduation 

Figure' 1: Experimental Design for the Longitudinal Sfudy 

research design uAd for the cross-sectional giroupsN is shown in 
Figure 2>, It is a static-group comparison desigit (Ca«(ibell and Stanlej^ 
1963) with the post-treatment observation delayell for several years 
-•'^^^r the treatment. The author Implies the expaiimental subjecta for 
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this study v«rii th« sanw «tudients that took part In his pi^pvlous 
Btxxdy (Scottt 1970) t Howavtrt he does not ^^F^K ^he prevlotm data 
nor Indicate how theaa sttfdants* scores changed^ver tliiie---^the only 
comparlaptui laade are with tke comparison group. 



y ^ ^ 26 _^_X_^^ 0^ ^ X - occurred In grades 5, 6 and 7 

rt* 3A 0 0 - prior to hl^ sdiool gn^adu^tlon 
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Figure 2: Experimental Desl£^ for the Cross-sectional Study 
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Statistical comparisons of the experimental and comparison greups 
were made for ea^ of the six sub-scores of the SCST- for each of 
the three testing periods (two for the longitudinal study and one 
for the cross-sectional study). Chl-square was used to test for 
significant differences, between the experimental and comparison 
groups. A 2 X 2 contingency, table was constructed for each of the 
six SCSI categories with the median score In each category being used 
to determine whether an Indlvldiial's score was hlgji or low. The four 
cells were low experimental, hlg^ experimental, low coxqparlson and 
hl^ comparison^ 



' Findings 

' Th#' analysis of the results of the longitudinal study Indicated that 

students who had bedn exposed ^(o the jLnqulry teaching strategy had 
significantly higher descriptive-part whole (analytical) scopes qn 
the SCSI than th^ comparison groups for. both the 1966 testing and 
the 1971 testing. There were no significant differenced between the 
longltudlnalygroups for any of the other five ^CST categories. 

■' i r . . .. ^ ■ • • ■ ■ - ■ 

Tha analysis of the cross-sectional results Indicated that the exper- 
^ imtntal group had significantly hi gh^ scores on three /scST categories! 

descrlptlve-part whole, descrlptlve-whole, and categorlcal-^attrlbute, 
J than the* comparison group'. ' 



er|c . ; * ^2 J 



Th« afdiaii 8cor««vof the two compariaon groups (th« longltudliml and 
th« cro«a-«tctlonal) appMred to be qulie slodlar for all SCSI cate- 
( gorlea except for. categorlcal-ciasanamlAg. The author attributes 
the apparently higher performance of the'cross-rsectlonal group on 
\thls categotV to the fact that all the students In this group had 
high verbal abilities and were In the top academic track In school 
iihereas not all the ineinbers of ^e longitudinal group were In this 

track. • 

* • *. ' 

A non-statist leal comparison of the two experimental groups on the 
pre-graduatlon tests Indicated that the median scores for the longl- 
tudlnil group were conslsteiitly lower than those of th^ cross- 
sectional group for all categories of the SCST, The author attributes 
this to the fact that the cross-sectlonal*^ group had more hours of 
exposure to the Inquiry method. * 



Interpretations 

. • / 

The author concludes that, since similar results were obtained front 

both the cross-sectional and longitudinal studies, the Inquiry strat- 
egy method Influences a student's ability, to class-lfy objects towards 
a more descrlptlve-part whole (or analytical) style. He cites a 
ouaober of studies to support his view that the development of an 
analytical ability has Important Imollcatlons for Increasing student 
achievement In such disciplines as mathematics and science. However, 
he Indicates that th« development of stach an analytical orientation 
could haitaper creativity and productivity In'such areas as the airts 
and humanities and points out the ni^ed for further research to 
■asaees the total liiq>act of Inquiry strategies on students. 



^ AB$TRACTOR»S ANALYSIS ' , . 

/ 

Althouglh there Is a long history Of research In education and psycho- 
logy relating to how Individuals perceive their environments, process 
•tnaory Information, form concepts, and solve problems, 1|; ^s only 
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within the last 25 yea^s that research in these areas ^ has been organ-> 
i«ed and integrated using the concept /)f cognitive style. Much of 
the research on cognitive styles has focused on the fleld-dependent- 
fleld-lndependent dimension. The research relating to this dimension 
and its educational implications are sunnarlzed in a recent review 
(Witkin and others, 1977). Kagan, Moss, and Sigel (1^63) defined a 
related dimension which they termed, a person's style of categoriza- 
tion. The Sigel Cognitive. Style Test (SCST) was developed to assess 
the various styles of categotl^atlon• This conceptualization of 
styles and (the SCST do not appear to have beet^ widely accepted by 
the research comnunlty and are cited only rarely In the recent liter- 
ature. > 

♦ ♦ 
The study under review appears to build logically on the conceptuali- 
zation by Kagan, Moss, and Sigel (1963) and related studies '(Davis, 
^967 and Scott, 1967 and 1970). However, there are few follow-up v 
studies since this area of research appears to have fallen into dis- 
favor. Another reason for a lack of follow-up studies may be the 
recent efiiphasls on adapting instruction to the learner's aptitudes and 
cognitive styles rather than attetaptlng to modify the learner's aptl- 
tude or cognitive styleb to suit the discipline. The more recent 
approach is more defensible on mo.riiJ^ and ethical grounds because modi- 
fying something as basic as an individual's cognitive style vaSy have 
undesirable side effects. The possibility of a detrimental side 
effect of a shift to a more ^Salytical' style is indicated by Lee, 
Kagan and Rabson's (1963) finding that an analytic set could hamper 
creativity and productivity in areas such as the arts and humanities. 

* 

The validity of the study is weakened by the research design employed. 
The static-group comparison design falls to control for selection and 
nortallty as well as for interactions between selection and such fac- 
tors as maturation and the experimental treatment (Campbell and ' ' 
Stanley, 1963) . The study would have been Improved by the use of a 
research design such as the one depicted in Figure 3 which coniilnes 
the elements of a time series design and a nonequlvalent control \group 
design to Increase internal and external validity. The design would 
have been further strength edited if the subjects had been randomly 




Mflgncd to trftatiaant84 Ho»*v«rt random assignment Is not usually 
possible In the real iiorld of classroom research. 

\: oi 02. 0^ 04 05 

Figure^ 3: An Inp roved Research Design 

The "leader would have more confidence tn the validity of the findings 
If the author would have been more specific |||bout the extent and 
nature of the experimi^ntal treatment* The author indicates that the 
experimental subjects wete exposed to the inquiry strategy over a two 
or three-year period but provides no indication of the actual number 
of hours spent using this method. The author appears to have thfi.s 
infolrmatlon because he states thajt "the! cross-sectional group had* 
more hours of exposure to the Inquiry method. . .than the longitudinal 
inquiry 8|tudenta'* (p. 329) . Unfortunately^ the author did not include 
thi^ information in the report. There is also no indication that the i 
clasa rooms were monitored to ensure that the intended treatment / 
occurred as planned. ' ' 

, M *. . ' 

4 

It would be unfair to criticize the author for iising the relativelV 
rare SCST because when his researchHi^gan in 1962, there were no o^her 
measures^ of cognitive style suitable for use in classroom sittiatfoKif^ 
However^ this does point up the dangerXof attempting res earc^j^ / 
especially longitudinal . regearch, in an area where ^tandard tests . 

have not been developed. - { 

\ 

« t 

since the SCST Is not well known, the author should have been more 
careful In describing both the test and the scoring procedure used. 
Thf text of the report appears to Indicate that the SCST Is an 
llpisat^ve test — the sum of the six sub-scores fpr each sublet equals 
Oiralvc because each subjett resjjwnds to twelve cards with each 
^ponse being assigned to one of the six categories. However, a 
l^tudy of the medians given in the data tables and a related report 
•(Scott, 1970) indicates that the SCST is only seml-lpsatlve since 
jA subject may make more than one response per card.. Greater clarity 

* • ■ 



In this ••ctlon of th«^ rtport would have been helpful in Interpret- 
ing the results. 

The Authpr^descrlbeS thfe procedures he used for making the statistical 
coaparlBons with refreshing clarity. However, he neglects to mention 
that the procedure he ±i following Is for the^ median Jtest for two 



el, 1956) . The procedure he followed Is^ 
2 Is greater than 20 and the expected fre- 
greater than 5. Hopefully, these conditions 



Independent samples (Sle 

correct, provided n, + n 

"ft .l- 

quency In every cell Is 

were met. A ^reader woull have more confidence' In the residts of the 

* . \ 

tests If the authpr had hamed the test— the reader would then assume 

that the author was at leasb aware 6f the limitations on the tests.' 
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The position of the author's statement that the rejection level for 
the statistical tests was set at 0.05 Implies that he recognized the 
need for establishing Rejection limits before the tests were run. 
The author deserves cqfmmendatlon and emulation for thla fact alone. 
It would be a welcome /change If the educational research ,ref lotted 
the fact that researckers recognized the need for establishing rejec- 
tion limits before the fact and then used estimated effect siz| and 
p<>wer ana^ysi'^ (Cohfiii, 1971) to determine the sample size theylneeded. 



REFERENCES 



Campbell, D. T. /and J. C. Stanley. ."Experimental ^d Quasl-exp eri- > 
mental Designs for Research on Teaching." In Gage, N. L. |(ed.) 
Handbook ^f Research on Teaching . Chicago: Rand McNallyr& Co.. ' 
1963: ^ 



Cohen, 
Ne 



\J ^_Si^atistical Power Analysis for the Behavioral Sciences . 
iw^Tptki Academic Press, 1969. 



Davis, J. • Concept Identification as a Function of Cognitive Style. 
Complexity and Training Procedures; Technical Report 32 . 
Nadlsoni Research and Development Center for Cognitive Learn- 
ing, University of Wisconsin, 1967. 

Kagan, J»; H. Moss; and I. Slgel. "Psychological Significance of 
Styles of Conceptydrlzation." in Wright, J^. and J. Kagan 
(•ds.) Bjisj^c Coaative Processes in Childreln r^ Monograph of the 
Society for Itese^rrch In Child Development,/ Vol. 28, No. 2« 
Lafayette, IN:^ Child Development Publications, 1963. 



61 



Be 



L.; J. Kftgan; and A. lUOtson. "the Influence of a Preference 
for Analytical Categorization upon Concept Acquisition." « 
Child Development > 34:4337442, 1963. 

Scott, N. "Science Concept Achiev^^nt an.d Cognitive Functions." 
Journal of Research in .Scie|\ce teaching , 2:7-16, 1964. 

Scott, N. "Strategy of Inquiry and Styles of Categoriration." ^ 
Journal of Research in Science teaching , 4:143-lS4, 1966. 

Scottv N. "Strategy of Inquiry and Styles of Categorization: A 

three-year Exploratory St:udy." Journal of Research in Science 
Teaching ,. 7:95-102, 1970. [ 

■ ■- ' ■ \ 

.Suchman, J. "Inquiry training in the Elementary ScHool." The Science 
teacher , 27:42-47. 1960. \ ' \ ^ 

.^^iegel, S, Wonparametrlc Statistics for the Behavioral Sciences . 
New York: McGraw-Hill, 1956. 

Uitkln, H. A.; C. A. Moore; D. R. Goodenough; and P^W. Cox. "Field- 
dependent and Field-independent Cognitive Styles and Their 
Educational Implications." Review of Educat ional Research. 
47(l):l-64, 1977. " ; 



«2 

67 



V«iul«rbrouck«,. A. C.i Jr. "Evaluation 6f a Personalized Instruction 
Syatem in General Chemistry." Journal of Chemical Education . . 
$2(8) : 516- 5ia, 1975. "~" .■- , , ; , ^ 

Descriptors— *Autoln8tructional Programs; *Chemlstry; *College 
Science, *Cour8e Evaluation; Educational Research; Higher ' 
Education; *Ins Cruet ion; Programmed Instruction; Science 
Education • , 

Expanded Abstract and Analysis Prepared Especially for I.S.E. by . . 
Robert W. Johnsonj Tpwson State University.' 



Purpose ' * . 

r . ... < .... ' . . 

The purpose of the project wds to explore an alternative to the lecture 
format widely used In general college chemistry. The model selected 
for field' testing in this study , was th\ Personalized System of Instnib- 
tlon, PSI, developed by F. Keller. ' ' 



• ■••if- 



Raf lona 



Recent attempts to Improve student performance In college science have 
resulted in new approaches to Individualizing instruction* Programmed 
textSy modular self-pacing units of study » and coi]|puter-assisted . * 
inatrucjtional formats are being used more widely in the h]|.gher educa- 
tlon. Encouraged by the tesults reported by other investigators using 
the self-pacing mode, the author decided to tiest t\^e PSI model against ' 
the more traditional lecture format. * , 



Research Design and Procedures 

■ > 

the study sample was drawn from eight sections of general chemi9<^ry 
(111 and 112) during the school years of 1972-73 an3^1973-7A. Students 
knowingly selected either A sec tiotid ^lecture/mornings) or B sections 
(PSI/aftemoons) . Students, mainly freshmen and sophomores, were 
pursuing programs of study in biology ^nd the health-related sciences. 
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Jl^tfi 'trMtment groupa shared common <1) textbooks, (2) wi^ekly laboratory 
perlo4«, and (3i) final examinations. A tvo~hour department final exasi . 
concluded the •'first semester of^study. Xhe ACS - Cooperative- E„xamlna- 
tion In GeMral Chemistry wins given at the end of the second senfestet. 

. ■■ V ' ■ ■ _ . > >. 

Students In Sect Ion wete given four 50*-^nui^ .lectures per week.. 
Setftlon ^ students were given one 50-mlnute lecture per week plus 
three 5J>-mlnute testing" periods per welk.,^ Addlt^^ally, B students 
were aided \}y paid tutorial upperclass ^chemistry majort. • They moni-* 
tored student progress through 20. units qf material demanding 90 percent 
ma(iit€»ry^af each 'unit. Comparison data* fbr 'evaluating^ the two differ efit 
(Instructional formats were gatheted fr6m scores obtained on both final 
.examinations* Correlation co-;efflclents betwieen the five ACT (American 
College Testing) parameters and three variables were obtalYi<5d for the 
eight sekt ions. The three variables examii;ied were (1): fliial examlna- . . 
tion scores,'* (2) to^^X points earned in course, and (3) cumulative 
grade point averages: * 

' ■ ^ .'■ c: ....... . ' • ■ 

Fj^ndlnea ^. 

* ■ . <^ . ■ • . ■ 

Based upon a comparison of final .test scores at the end of the first 

t^rm of study, students In both A and 3 sections demonstrated about 
equal performance. Similar results were attained by both groups com- 
pleting the second term of study in 1^73-74 ♦ However, for the second 
term of 1972^73, PSI students achleVed significantly^ higher scores 6n^ 
the ACS— Cooperative Examination than did their lectured counterparts. 

• -c ' ^ • ■ ; ■ ■ 

Of th^ five ACT Test parameters, studeht mathematical scores were- 
found to Correlate with eaich of the thrWe variables more frequenAy 



and With the hlgly^t level of confidence. 

Repotted also was the fact thaj: a far higher percentage of A and B 
course grades were awarded tjBT'PSI' students over the two-year trial 
period. VwJ ' . _ 



jftl^Tpretatlons 

The author concluded from the test results that PSI stydeiits were learn- 
ing at about equivalent levels to students o& comparable ability in 
lecture section^. Nonetheless, the mean score of the 1972-73 PSI 
sections were higher on the ACS - Cooperative Examination, the second 
• semester chemistry final exam. This difference, in performance was 
attribt^ed to better mathematics" ability dentonstrated by PSI students 
on the ACT Test and not td the method erf Instruction, 

In evaluating the course, pup IpL, observation supported the notion that 
PSI students left the coursiff with a better' jicefellng about chemistry. 
The author suggested in hla assessment of the dour^e that PSI students 
speared more "actively Involved In the course and attained betteir* 

retention of material* He Implied that self-pacing developed In 

. ^ . . t 

students a more positive feeling about chemistry and that ^ In general, 
a btetter attitude^ about learning was engendered* 



ABSTRACTOR'S ANALYSIS 



' * . . . . # 

the study, herein reviewed, is but one of many being reported In the 
literature. It attempts to ^ompare and evaluate student performance 
resulting from two different, approaches to college Instruction, e*g*, 
lecture versus self-r^paclng study. The findings here fall to support 
the superiority of one Instructional format over the other* Neverthe- 
less, results do underscore ythe' contention that the PSI approach can 
be an effective alternative teaching/learning model when ''certain 
conditions are met. Teachers do teach and student^ do learn. But 
does it necessarily follow, then, tha.t all students learn better when 
taught by the self-pacing method? The larger body of research purport- 
ing to compare the effectiveness of PSI to the lecture approach seems 
to suggest. «n answer in tfie negative. OAe generalisation Is most 
frequently offered by investigators assessing the Keller model: PSI 
enhances and improves student attitudes toward' l%if(j^ ^e author 

of this study concurs with (hat assessment* 

"* ^ *» .. ' * 
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Thii Personalized Syfltam p£ Instruction, admittedly. Is a fairly recent 
Innovation a^ the college levftjl* The advantage la that students, given 
precise Instructional objectives, can move through a module of mateci^ajL' 
and master It at iKelr ovm pace. Its major limitation resides within 
Its own methodology* The habit of procrastination may not be effec- 
tlvely managed by some self^paclng students* * 

Therefore^ to sUggest that only PSl students becoine actively involved 
in the learning process is ta, discount the concept of individualizing 
instruction. Learning styles differ greatly among students. Teach- 
ing styles and formats dlso differ. The problem, then, is to find a 
proper fit between teaching former and a particular learning style 
which produces* maximum studeAt performance* Certainly, PSI may be 
one of many approached to effective Instruct lotie 

Given the requisite tools ^skills, and cognitive development, the idea 
of making a student personally responsible for his/her learning is not 
a n«w concept in education*. It was pot the jf^urpose of this study to 
advance or explore new ground* 

The study*s research design was carefully planned and executed* The 
sample was limited but adequate, and controlled for comparison pur- 
poses* Quantitative perfonhance data in the form of student test 
scores were collected and tabulated in table form* Correlation co- 
efficients between selected parameters and significant variables were * 
obtained at the 0*01 and 0*001 confidence limits* Comparative analy- 
sis of data gj^theted from the two treatment groups produces no 
significant evidence to. suggest that a Personalized System of 
Instruction was better or worse than lecturing td 'students In college 

x 

chemistry courses. 



One wonders if other variables aside from instructional format might 
not have a greater effect upon improving student perfortnance. Indi- 
vidualized learning styles of studellits most certAinly affect the 
teaching/learning relationship Just as teaching style does. Instructor 
enthusiasm for his subject or a dynamic persom^lity may Just preclude 
the superiority of one instruct lonal approach to another. Gifted 
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Uacl^ttrt can be found amongst lecturers, demon's t ret ors. and faclll- 
tators In education throughout history. What attributes are the binch- 
mairkii of gifted and effective teachers? What formal training in theory 
and practice should be required to produce competent teachers /in higher 
education? These qubstioils pose problems for on-going resear(||h. What 
this study does support strongly is the contention that PSI options 
should be^made available to students in co\x0ea that are freely ^ 
entered into by .competent faculty. 

Perhaps the best way to Insnte Improved student performance is to 
guarantee improved instruction. Much still needs to be done in the 
area of training college teachers to teach effectively. Irrespective 
of degrees l^eld, many college teach«rs have little or no profess i^al 
background in education. None hold ]()rofessioifal licenses or certifi- 
cates to practice their teaching skills in higher education within m- * 
single state. Maybe state licensing boards need to be established 
to set standards and review credentials of those' seeking teaching 
positions in higher education. None presently exist. 
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A REMtfSE TO THE ANALXSIS OP 

. . 

Moore, Kenneth 0. and Jacob W. Blanllcenshlp . ",TeA:hlng Basic Science 
Skills through Realist^: Science Experiences In /t-he Elementary 
School," by Donald E. Rlechard for Investigations In Science 
Education . 5(4):12-18, 1979. 

* \. . •, - ■ 

by • 

Kenneth D. Moore 
, University of Science and Arts of Oklahoma 



In revlewling the abstractor's analysis of our article, several coimeiitj 

appear to /be In order. • ^ ' . * '^'^ 

/ • • - * 

• 1 

First, thii use of the word "frugal" In the leading sentence of the 
second paragraph of the Written Report section appears to be mislead- 
ing as,to|the abstractor's Intention. The use of this word suggests 
that the abstractor fo.und the study lacking with respect to our 
presenttftlpn of related research and with respect to' a rationale for 
the study^ However, this, Is Inconsistent with the subsequent comments 
Ins this paragraph « 



The abstractor further notes that the study Is weak with regard to 
validity and Reliability. Althouj^h "construct validity" of the assess 
meot instrument has been established and reported, the abstractor Is 
correct In reporting that concurrent or predictive validity of the 
assessment Instrument has not been established. This limitation 
«sh6u!^d be kepi^ln mind by potential users of the study results, 
Sinc^ It was /not expedient to administer the assessment instrument 
to e^Ch respondent a second time, I tend to agree that reliability 
has hot been rigorously established. However, It q|hould be noted 
thAt th:|s research study deals with averages and these averages wlli, 
of cOurs^, be much more reliable than Individual responses. More- 
over, the\ randomization procedure utilized In this study greatly 

\ance8 t\^e reliability and ext<*rnal validity of the findings. The 
•utnbrs therefore feel the iesults can be generalized to the elemen- 
tary teacher population wltA a fair degree of confidence. 
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In his closing remarks, the abstractor concludes that the study does 
not^create any new or unique knowledge. He further suggests that 
"providing realistic science experiences" becomes a high priority d 
need factor only after other higher priority need fjjctprs have been f 
^t. ptese closing remarks suggest that the abatnrct^r Incorrectly 



Interpreted t\he findings « 



.4 



The authors siliggest that the Identified^f actors (Table 2,\age 34(J, 
Science Education article) as well as the high loading' Items of each 
of the Identlfle'd high pirlorlty factors needs to be reexamined « 
Although the authors do agree that this study confirms the findings 
of past research In that the moat iqjpiioprlate programs for science' 
education appear to be those which pr^v^e ''ireallstlc science exper- 
lences^" the study goes beyond mere confirmation* The reslilts suggest 
that science teachers view Vprovidlng realistic science, experiences" 
as being a higher priority need than such needs as those in the areas 
of discipline, reading, writing, mathematics, and speliln^;. Further- 
more, an exan^ination of the high loading ijiCms on fact^need I 
'*P.rovlding realistic science experiences" suggests some o^ the con<**^ 
straints' which 3eem to be keeping science teachers from providing 
these more appropriate "realistic science experiences*' in their 
classrooms « 

While there is disagreement on several points, the abstractor has 
made several enlightening ai^d^'vlilld points which., if addressed, 
would make this study and future similar research much stronger* • 
We weH^ome and wish to thank\hlm for his critical analysis of out 
works 




^ RESPONSE TO fHE ANALYSIS OF 



Peterson, Kenneth D. "Scientific Inquiry Training for High School 
Students: Experimental Evaluation of a Model Program," by 
John R. Staver. Investigations in Science Education , 5(4): 
29-36, 1979. 

V 

Kenneth D. Peterson 
University Utah 



I appreciate the, critique of my recent research report (Peterson, ^1978) 

which appeared in Investigations in Science Education (Staver, 1979) • 

It is of service to researchers to have pertinent and responsive reviews, 

^here were a number of que^stions raised in the critique which, I ''think, 
are^nswered in the ortginal article: 

■ ■ $ 

1* Only one scientific inqujlry assessment instrument was used in 
the study It was administered to half of each of the three treatment 
groups as a pretest and to all /subjects as ^posttest. No pretest 
experience effects were found. 

2. Varimice explained by treatment (omega squared) for each of the 
15 dependent variables ranged from .02 to ^64 (not .OA). 

3. The scientific Inquiry training treatment group (SI) was 
superior to t*\e verbal instruction tifeatment group (VI) on 6 of the 
15 variables; the VI group was superior to the SI group on none.^ 

» 

The posttest means , and standard deviations are presented in Table 1^ 
They were omitted because of space limitations. ' 
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Table 1 



PoBtt«8t Results — Treatment Scores: Means and Standard Deviations 



TREATMENT GROUP 



Project Physics Verbal Instruction . Science Inquiry 



(N-24) 



(N-17) 



(N-26) 







Mean , 




nean 


b.D. 


Mean 


S.D. 


1. 


Number of Variables 

4 


A. 29 


1.51 


8.65 


3.35 


9.77 


3. 53 


2. Vdhrlable Points of View 


1.71 


.53 


lAl 


.82 


2.96 


.^8 


3. Uncued Variables • .. 


.12 


-.26 


. 1.00 


.92 


1.12 


1.20 


4. 


)lvergent Variables 


.21 


A 


1.06 


.89 


1.96 


1.94 


5. 


dumber of Questions 


4.17 


1.57 


8.06 


2.54 


7.12 


2.63 


6. 1 


Question Points of View 


1.83 


.55 


2.88 


.84 


3.12 


.85 


7. 


Jncued Questions 


.37 


.56 


.59 


,93 


1.00 


1.55 


::i 


divergent Questions 


.54 


.69 


.76 


.71 


1.85 


1.93 




3fbstlon Criteria 


.96 


.75 


1.88 


1.52 


2»77 ' 


.95 


0. 


Experimental Components 


1.79 


1.13 


2.53 


1.56 


4.19 


1.06 


\. Number of Generalizations 


1.25 


1.13 


1.53 


.98 


1.27 


.50 


1. Form of Generalizations 


.71 


.43 


.53 


.53 


.65 


.48 


3^ i 


^cidltions to Investigation* 


2.08 


1.02 


2.53 


1.42 


2.15 


1.41 


a; 1 


Science Processes 


4.^ 


i,n 


4.65 


1.94 


8.23 


2.15 


5* Relations Among Processes 


.42 


V .49 


..65 


.40 


.96 


.14 



77 



ERIC 



My r««dlng of Ausubel suggests that It was reaaotl^ie to expecti hl^h 
schpol seniors to be at an "abstract-verbal" stage and not at the 
"concrete-intuitive" stage which it replaces in "the latter .portion 
of the Junior high school periqc^*' (Ausubei, 1963, pp. 133-5). Thus, 
Xji was anticipated that the verbal Instruction group , which received 
Instruction aa per Ausubei, Vould have performed as well' or better 
than subjects completing other types' of Instruction. (The Vi Instruc- 
tion was designed to "teach to test*' to the samg^gree as the SI 
Inatructlon). 

'The reviewer discounts my concluslpn that the Au$u^llan predictions 
did not hold for some kinds of scientific Inquiry performances. He 
offered the Interpretfetipn that the students j^ere at various stages 
of Plagetlan development (1.^/^^ some hot yet at a level of formal 
operations). While the literature cited certainly backs this point 
of view, his statement changes Ausubei' s explanation'. The result is 

Ehetlc Interpretation which combines both Ausubei and Plaget. 
this makes sense to me, and Is probably a more adequate 
tlcal explanation. It Is not pure Ausubei. One point of Che 
study was fco test Ausubellan theory. I still offer the conglu^on 
that Ausubella^ principles do not hold uniformly .well for All kinds 



of 8clentlfl\ Inquiry learnings. 
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A RESPOnSE TO THE ANALYSIS OF 

Suter, Patricia E. "Using Audio-Visual Study LessonlTto^ Teach the Under 
prepared Student," by Elizabeth Kean.' Investigations in Science 
Education , 5(4): 37-41 , 1979. ' • 

by ^ 

' Patricia^. 'Suter . . 

^ Dei Mar^ollege 

Your inclusion of my article "Using" Audio-Visual Study Lessons to Teach 
the Unprepared Student/' published in School Science and Mathematics ^ ^ is 
greatly appreciated. 1 would like to make the following comments on the 
critique: * 

1. The cdurse of instruction for which. the lessons were designed 
is now what we classify as "introductory." The college has two other 
courses using this designation, which are taken by liberal arts students 
or health 'science students^ The coiirse taken by students using the 
lessons is called General Inorganic Chemistry which Is taken by those 
expecting to attain a bachelor's degree in a field of science, mathe- 
matics, or engineerings ' ^* 

2. The term "better student" refers to those receiving grades of 

"A" or, "B". The final examination given in the course Is thai prepared 

by the .American Chemical Society, and these students compare well with 

the national norms. ^ 

t 

3. The lessons were prepared to help students learn the required 
material. Instructors at Del Mar College operate under the theory that 
It is their Job to tell the student what he or she must learfi and to 
provide fll possible lielp InyrTTiat learning process. The A<-V Study 
Lessons have provided some of that help* Over 300 stiidents a year use 
one or more of the lessonii. The students themselves are the judge of 
the effectiveness of the lessons ancKxhey continue to report that they 
find thett to be; of great assistance. /Therefore, * We contlnueyto believe 
that tlie preparation of these lessons iras worth the time, effort and 
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^a«y txpcnded In their preparation^ Wc 4ve continuing to modify the 
leetons as the need arises, • , 

A. The background of the students attending Del Mar College Is 
..diverse. Many have language difficulties as well as problems in deal- 
ing with mathematical concepts. Entrance examination scores continue 
to decline nationwide in both these areas. Our students are- attending 
college to become better able to compete in a technological, English ' 
yspeaking work situation. No bilingual leAons were prepared, nor are 
contemplated. Our Spanish speaking students are not more 'adept .in that 
language than in English because most learn a mixture of English and 
Sp&nish at home, pther languages (German, Czech, Chinese, Vietnamese) 
Sre the first languages of a significant part of the student popula- 
tion. No student has ever requested the lessons in "some, other language 
even though anonymous polls are taken each semester and a suggestion 
box- Is available for the students to use. The lessons are modified 
periodically, either to irtborporate student suggestion, or to include 
new material. 




5. Follow-up studies of the students registered in General 

Inorganic Chemistry have shown that most (81 percent) of the students 

Who failed or dropped the cours^did not use the study lessons at all. 

Many of these students are working\and have little time for study. 

The usage of the study lessons Increases during the. latter part of 

the first semester and the second semester* Probably this Is due to 

unsuccessful students dropping out or falling^ and the remaining 

students finding that the lessons do help them learn. It may also be 

due in part to some students who had high School chemis^try realizing 

^at they do not know as much chemistry as they thought they did at 

the beginning of the first semester. Some have commented that this 

1» so. ' ^ . ' . 

\ ^ 

w 

6, The members of the chemistry faculty at Del Mar College are 
not drained in educational theory. We are merely trying to provide 
aids for ou/^ students to assist thel|: learning of the required mater- 
lal. They are given detailed lists of objectives for each unit of 
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•tttdy and glossarlca of n«w technical texfma. No other control of 
the vocabulary Is attempted on the tapes nor in the daearoom. How- 
ever, unusual words are defined the. first time they are used. 

♦ 

1* Design details are available from the author. (Write: ♦ 

* ■ ♦ - 

Patricia H.Suter, Associate Professor, Dept. of Chemistry, Division 
of Arts and Sciences, Dfl Mar College, Corpus Christ 1, Texas 78404.) 

8. Presently the faculty at Del Mar College Is offering other 
study aids to our students, these are CAI unit sV some multiple teat- 
Ing after the, Keller plan, and aupferylsed tutoring. The students are 
not required to use any of these aids. The responsibility for learning 
is, in oUrApiWon, the student's. We are there to help and encourage 
the pcoc^s. * 
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